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CHAPTER  I 


INTRODUCTION 
Development  of  the  Problem 

The  impetus  for  the  study  of  the  ambulatory  care  Quality  Assurance  Program 
at  the  US  Army  Medical  Department  Activity,  Fort  Belvoir,  Virginia,  is  the 
collective  lack  of  useable  information  by  which  the  hospital  staff  can  make 

intelligent  decisions  regarding  the  quality  of  ambulatory  care.  Repeatedly,  the 

"'Q 

outcome  of  quality  assurance %Q A)  related  committee  meetings,  e.g.,  the  Medical 
Care  Evaluation  Committee,  Ambulatory  Care  Committee,  and  other  quality 
assurance  functions,  was  not  useful  because  the  committee  was  unable  to  identify 
problems.  This  inability  to  identify  problems  is  related  to  the  lack  of  information 
available  to  the  committees.  Although  data  is  present,  it  is  either  not  properly 
summarized,  incomplete,  or  not  communicated  in  a  useful  manner.  Data,  by 
definition,  is  not  information  due  to  the  fact  that  it  does  not  convey  a  complete 
picture.  ■'  tr.  •  r-  j, 

The  Chief,  Professional  Services, has  repeatedly  expressed  his  frustration  at 
the  lack  of  useful  quality  assurance  results  by  the  committees,  departments,  and 
activities  of  the  institution.  In  addition,  the  shortcomings  of  the  hospital  Quality 
Assurance  Program  have  been  noted  by  the  Joint  Commission  on  Accreditation  of 
Hospitals  (JCAH)  on  their  most  recent  accreditation  visit  (June,  1981).  Also,  the 
General  Accounting  Office  conducted  a  five  week  survey  of  hospital  quality 
assurance  programs  and  noted  shortcomings  highlighting  the  need  for  more 


The  increasing  importance  of  quality  assurance  as  evidenced  by  the  heightened 
interest  of  regulatory  agencies,  both  private  and  governmental,  and  the  rising 
expectations  of  consumers  mandates  that  the  administrations  of  hospitals  institute 
effective  and  efficient  quality  assurance  programs.  Major  General  Raymond 
Bishop,  Commanding  General,  United  States  Army  Health  Services  Command, 
specifically  addressed  the  issue  of  quality  assurance  in  troop  medical  clinics  and 
health  clinics  within  the  command  as  being  of  primary  interest.  1  General  Bishop 
expressed  grave  concern  over  the  quality  of  care  provided  in  the  outpatient  setting. 
In  order  to  assure  that  the  care  provided  in  those  settings  is  optimal,  he  stressed 
quality  assurance  programs  to  measure  the  efficacy  of  health  care.  To  validate  his 
interest,  General  Bishop  has  instructed  the  Inspector  General  of  Health  Services 
Command  to  evaluate  the  quality  of  health  care  being  provided  in  the  ambulatory 
care  settings  throughout  the  command. 

Statement  of  the  Problem 

To  determine  the  best  system  for  ambulatory  care  activities  to  gather 
information  to  evaluate  the  quality  of  outpatient  care  provided  at  the  US  Army 
Medical  Department  Activity,  Fort  Bel  voir,  Virginia. 

Objectives 

The  objectives  of  this  study  are  threefold: 

1.  To  determine  the  type  of  information  which  is  needed  by  outpatient 
organizations  to  evaluate  the  quality  of  care  provided  by  that  clinic.  Concurrent 
with  that  initiative  is  the  determination  of  the  proper  source  of  the  needed 
information. 
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2.  To  develop  a  methodology  for  extracting  the  needed  data  and  converting 
it  to  useful  information. 

3.  To  create  a  vehicle  for  displaying  the  information. 

Criteria 

The  criteria  by  which  the  results  will  be  evaluated  against  will  insure  that: 

1.  V,:u  methodology  for  extracting  data  and  its  conversion  to  information 
must  be  performed  by  clerical  or  paraprofessional  personnel. 

2.  The  source  of  the  data  must  be  readily  available. 

3.  The  vehicle  to  display  the  information  must  be  standardized. 

4.  The  information  must  be  acceptable  to  the  chnic/activity/department 
chief  conducting  the  quality  assurance  program. 

Assumptions 

The  course  of  this  study  will  be  guided  by  several  factors  which  are  assumed 
by  the  author  to  be  true  and  will  determine  whether  the  study  will  be  viable  in  the 
future.  Those  assumptions  are: 

1.  The  need  for  quality  assurance  activities  will  not  diminish. 

2.  Clerical  and  paraprofessional  personnel  will  be  responsible  for  gathering 
the  data,  converting  the  data  to  information,  and  displaying  the  information. 

3.  The  recommended  method  for  gathering  information  will  be  applicable  to 
all  outpatient  clinics. 

Limitations 

The  following  limitations  will  be  utilized  in  evaluating  this  program: 

1.  Only  high  volume  clinics  will  be  used  as  models  to  analyze  and  develop  the 
quality  assurance  activities  of  ambulatory  care. 
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2.  The  individuals  who  will  perform  the  data  gathering  and  other  tasks 
involved  in  the  system  will  be  from  existing  resources. 

3.  Additional  resources  will  not  be  available  to  the  hospital  to  gather  the 
information  needed  to  assess. 

Research  Methodology 

In  order  to  fulfill  the  objectives  of  the  study  the  following  research  techniques 
will  be  utilized: 

1.  Identification  of  needed  information. 

a.  Consult  appropriate  literature. 

b.  Interview  the  professional  staff  of  the  outpatient  facility. 

2.  Identification  of  data  sources. 

a.  Consult  with  the  US  Army  Patient  Administration  Systems  and 
Biostatistical  Agency  (PASBA). 

b.  Investigate  the  information  locally  available. 

(1)  The  patient  Health  Record/Outpatient  Treatment  Record. 

(2)  Laboratory,  radiology,  and  pharmacy  data. 

(3)  Patient  representative  data. 

(4)  Patient  Administration  Division  maintained  data. 

(5)  Uniformed  Chart  of  Accounts  data  maintained  by  the  hospital 

comptroller. 

3.  Method  for  extracting  data. 

a.  Automated  systems  available  from  PASBA. 

b.  Locally  maintained  statistics  (laboratory,  radiology,  and  pharmacy 
data). 

c.  Application  of  statistical  techniques  such  as  sampling. 
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d.  Use  of  concurrent  or  retrospective  data  collection. 

e.  Establish  the  criteria  for  extracting  data. 

Display  of  data. 

a.  Analyze  the  nature  of  the  data  collected  and  determine  the  most 
appropriate  type  of  display.  Possible  alternatives  include: 

(1)  Descriptive  statistics  (mean,  standard  deviation,  mode,  etc.). 

(2)  Trending  as  a  method  to  determine  abnormalities. 

(3)  Tests  of  statistical  significance  (Chi-squared,  T-Test, 
correlation). 

b.  Develop  a  worksheet  to  consolidate  data. 

c.  Utilize  currently  available  statistical  packages  on  the  hospital  Hewlett- 
packard  minicomputer  design  mechanism  for  inputing  the  data  and 
producing  useable  information  for  the  clinic  chief. 


Footnotes 


llWajor  General  Raymond  Bishop,  "Keynote  Address,"  presented  at  the  US 
Army  Health  Services  Command,  Ambulatory  Care  Conference,  Fort  Sam  Houston, 
Texas,  29  March  1982. 


CHAPTER  II 


LITERATURE  REVIEW 
Introduction 


Quality  assurance  is  not  a  subject  for  debate,  its  time  has  arrived.  1 
Verification  of  the  mandate  for  quality  assurance  is  widely  published  in  federal 
law,  national  hospital  accreditation  standards,  and  Department  of  the  Army 
regulations. 2)  3,  4,  5  The  impetus  for  quality  assurance  activities  is  two-pronged. 
The  critical  issue  in  assuring  the  quality  of  care  provided  is  improvement  of  health 
status  of  the  patient. 6  Concurrent  with  the  need  for  quality  health  care  is  the 
need  to  control  the  rising  cost  of  providing  health  care. 7  Although  the  thrust  of 
quality  assurance  activities  has  been  centered  in  the  inpatient  setting,  there  is  an 
overwhelming  need  to  carry  the  quality  assurance  banner  to  the  ambulatory 
setting.  The  volume  of  patients  seen  in  the  outpatient  setting  is  tremendous, 
approximately  89%  of  illnesses  are  treated  in  the  ambulatory  mode.8  Even  though 
the  per  patient  expense  of  outpatient  care  is  obviously  much  lower  than  an 
inpatient  visit,  the  magnitude  of  volume  of  outpatient  visits  necessitates  an 
evaluation  of  the  care  provided.  For  every  person  admitted  to  DeWitt  Army 
Community  Hospital  37  patients  are  seen  on  an  outpatient  basis. ^ 

Structure,  Process  or  Outcome 

With  the  tremendous  number  of  outpatients  being  seen  in  an  ambulatory  mode 
the  target  of  quality  assurance  programs  heretofore  has  relied  heavily  on  the 
structure  of  the  system.  Structure  refers  to  innate  characteristics  of  the  providers 
(physicians,  dentist.,  nurses,  etc.),  such  as  age,  type  of  medical  training  and 


degree,  and  practice  of  the  physician.  10  The  structural  approach  assumes  that 
given  the  proper  mix  of  training,  age,  and  experience  a  provider  would  fulfill  the 
needs  of  the  patients.  The  guardians  of  the  structural  system  of  assuring  care  are 
the  members  of  the  medical  professions  via  state  boards  of  licensure,  medical 
societies  at  the  county,  state,  and  national  level,  and  faculties  of  medical  schools. 
The  effectiveness  of  the  structural  method  is  questionable.  The  increase  in 
malpractice  lawsuits,  the  maldistribution  of  medical  practitioners,  and  the  claims 

of  unnecessary  surgery  indicate  that  the  effectiveness  of  the  structural  method  is 
suspect.  1 12,  13 

The  process  method  of  quality  assurance  activities  is  centered  on  the  events 
which  occur  during  a  patient  encounter.  The  process  includes  the  patient's  history, 
physical  findings,  laboratory  studies,  radiographic  tests,  drugs  prescribed,  patient 
instructions,  and/or  any  other  intervention  which  might  be  considered  necessary  in 
treating  a  particular  patient.^  The  process  has  significant  advantages  over  the 
structual  method  in  that  attention  is  focused  on  what  occurred  during  the 
encounter,  not  merely  how  prepared  the  provider  was  for  treating  the  patient.  The 
effectiveness  of  the  process  review  has  been  demonstrated  in  several  s  lies.  In 
New  Mexico,  a  process  review  was  used  to  count  the  inappropriate  use  of 
antibiotics.  The  process  review  was  successful  in  reducing  the  frequency  of 
inappropriate  use  of  expensive  antibiotics.!5 

The  last  method  of  reviewing  the  quality  of  care  is  the  outcome  method.  The 
outcome  method  is  concerned  with  the  net  result  whether  it  be  cure,  control  of 
disease,  or  symptomatic  improvement.  The  ultimate  quest  of  quality  assurance  is 
to  improve  the  health  status  of  the  patient.  The  outcome  method  focuses  on  just 
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that,  the  health  status  of  the  patient.  The  structural  method  only  certifies  the 
initial  competence  of  the  provider  and  the  process  method  only  assesses  the 
fulfillment  of  measurable  inprocess  milestones.  Neither  of  these  methods  assesses 
the  quality  of  the  end  product,  the  patient.  The  logical  question  then  is  why  not 
use  outcome  as  the  sole  measurement  of  quality?  The  answer  in  part  is  that  the 
great  majority  of  conditions: 

-  are  self-limiting, 

-  are  intimately  involved  with  personal  life  style, 

-  are  chronic  conditions  where  a  good  outcome  is  often  temporary  arrest  of 
the  natural  cause  or  restoration  of  some  function,  but  is  in  either  case  dependent 
on  nursing  and  social  support  rather  than  medical  care, 

-  are  conditions  for  which  modern  remedies  are  only  partially  effective, 

-  require  short-term  counseling  or  reassurance,  often  effectively  practical  but 
generally  unrecorded,  and 

-  are  uncomplicated,  acute  infections  for  which  antibiotics  are  readily 
prescribed.^ 

In  addition,  from  25  to  70  percent  of  patients  coming  for  care  are  actually 
well  or  "worried  well". 

The  net  result  of  the  three  methods  of  assuring  quality  is  individually 
ineffective  in  improving  the  quality  of  care.  There  is  a  place  for  each  of  the 
methods  in  the  overall  quality  assurance  program.  The  structure  of  the  health  care 
system  is  well  defined  by  the  operating  programs  of  hospitals.  They  include: 

-  a  credentialing  process, 

-  a  training  program,  and 

-  an  equipment  and  facilities  upgrade  program. 


The  process  method  is  the  foundation  for  the  appraisal  of  the  compliance  of 
the  professional  with  established  patient  care  criteria.  The  existence  of 
imperfections  in  the  process  method  should  be  recognized  by  the  professional  body. 
Criticism  of  the  process  method  is  well  documented  in  the  literature  and  is  well 
founded.  18,  19,  20,  21  in  light  of  the  shortcomings  in  the  process  review 
methodology,  its  ability  to  demonstrate  behaviors  is  critical  in  order  to  fulfill  the 
tenets  of  the  accreditation  standards  espoused  by  the  Joint  Commission  on 
Accreditation  of  Hospitals. 

The  outcome  quality  of  care  assessment  method  is  the  optimal  method  but  is 
the  most  difficult  to  define.  The  health  status  of  an  individual  includes  more  than 
a  simple  physical  assessment  of  an  individual  body.  The  World  Health  Organization 
includes  in  its  definition  of  health  status  the  "complete  being"  that  encompasses 
the  emotional  and  social  as  well  as  the  physical  aspect  of  the  being.22  The 
wholistic  movement  has  brought  the  "total  man/woman"  issue  to  the  forefront  and 
as  yet  this  issue  is  not  resolved. 2^  In  order  to  avoid  the  pitfall  of  attempting  to 
define  "improved  health  status"  the  basis  of  an  ambulatory  care  quality  assurance 
program  would  be  wise  to  recognize  the  outcome  aspect,  and  focus  its  efforts  on 
the  more  tangible  aspects  of  a  process  orientated  methodology. 

Implicit/Explicit  Judgement 

The  process  system  can  be  based  on  a  combination  of  implicit/explicit 
judgement  and  concurrent/retrospective  data  collection.  The  difference  between 
explicit  and  implicit  judgement  is  the  pre-establishment  of  criteria.  The  implicit 
judgement  is  based  solely  on  the  personal  experience  and  training  of  the  individual 


reviewer.  The  reviewer  audits  a  medical  record  and  determines  whether  the  proper 
medical  steps  in  diagnosis  and  treatment  were  taken  based  on  his/her  opinion  of 
what  constitutes  quality  care. 2^  This  method  of  assessing  care  is  extremely 
flexible  but  requires  a  high  degree  of  knowledge  on  the  part  of  the  reviewer  and 
the  results  are  unreliable. 25 

The  explicit  review  removes  the  judgmental  situations  which  are  incorporated 
in  the  implicit  system.  The  explicit  review  is  based  on  a  set  of  written  standards 
established  by  appropriate  providers.  This  system  increases  the  reliability  of  the 
review  and  allows  paraprofessional  and  clerical  personnel  to  perform  the  review. 26 

A  study  conducted  by  Johns  Hopkins  physicians  of  296  patients  at  Baltimore 
City  Hospital  used  both  the  implicit  and  explicit  methods  for  assessing  the  quality 
of  care  provided. 27  The  diagnosis  for  these  patients  was  either  hypertension, 
urinary  tract  infection,  or  gastric/duademal  ulcer.  The  296  records  were  reviewed 
using  implicit  judgement  of  the  process  and  the  result  was  that  23  percent  of  the 
charts  were  acceptable.  The  same  charts  were  then  reviewed  against  explicit 
criteria,  and  the  result  was  that  one  percent  of  the  records  met  the  acceptability 
standards. 

This  study  points  up  the  wide  variation  which  can  exist  between  implicit  and 
explicit  judgement  in  reviewing  medical  processes.  This  variation,  coupled  with 
the  problems  of  unreliability  and  expense  associated  with  implicit  judgement 
indicates  that  explicit  judgement  is  the  method  of  choice. 
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Prospective,  Retrospective,  and  Concurrent  Assessment 

The  quality  assurance  standard  of  the  Joint  Commission  on  Accreditation  of 
Hospitals  states  that  "once  an  actual  or  suspected  problem  is  identified,  it  may  be 
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assessed  prospectively,  concurrently,  or  retrospectively. "2S  in  the  ambulatory 
setting  the  collection  of  data  needed  to  conduct  reviews  or  audits  of  patients 
encountered  is  not  systematic  and  centralized  as  is  the  case  in  inpatient  care.  This 
lack  of  a  systematic  data  collection  effort  severly  limits  the  ability  to 
retrospectively  analyze  care.  Because  over  1  billion  outpatient  visits  occur 
annually  in  the  United  States,  a  system  for  centrally  collecting  data  is  not 

imminent. 29 

The  prevalence  of  quality  assurance  studies  documented  in  the  literature 
reflects  computer  assisted  data  collection  techniques. 30,  31,  3 2  The  billing 
function  in  private  practice  provides  a  natural  index  for  identifying  patient 
diagnosis  and  treatment  data.  In  those  practices  with  automated  billing,  the 
practitioners  capitalize  on  the  captured  data  to  identify  patients  with  a  specific 
diagnosis  or  an  identifiable  treatment.  The  Harvard  Community  Health  Plan  uses  a 
computer  stored  ambulatory  record  (COSTAR)  system  to  record  patient  data.  This 
system  significantly  improves  the  efficiency  of  the  plan's  quality  assurance 
efforts. 33  The  Army  Medical  Department  is  currently  testing  the  COSTAR  system 
at  Fort  Ord,  California. 3^  The  results  of  the  test  are  not  completed  and  possible 
proliferation  of  the  COSTAR  system  through  the  military  hospital  system  is 
uncertain. 

Without  the  aid  of  computerized  systems  for  records  retrieval,  the 
retrospective  audit  technique  is  not  a  viable  method  for  conducting  quality 
assurance  studies.  The  concurrent  audit  procedure,  which  is  based  on  the  premise 
that  the  chart  is  reviewed  shortly  following  the  patient  encounter,  is  a  plausible 
alternative  to  retrospective  review.  The  term  shortly  is  used  to  describe  the  time 
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lapse  between  encounter  and  review  because  the  actual  time  can  vary  from 
minutes  to  days.  Concurrent  review  is  used  to  alleviate  the  personnel  cost 
associated  with  records  retrieval  and  to  cut  the  time  to  complete  a  study. 35  The 
effectiveness  of  concurrent  review  is  not  only  in  the  retrieval  of  records  but  also  in 
corrective  patient  intervention. 

The  Automated  Military  Outpatient  System  has  been  used  for  over  five  years 
in  Army  hospitals  to  treat  large  numbers  of  outpatients  by  utilizing 
paraprofessional  personnel  to  treat  minor  illnesses.  Incorporated  in  that  program  is 
a  mandatory  concurrent  review  mechanism. 36  This  review  detects  general  trends 
in  the  quality  of  care  provided  and  specific  treatment  shortcomings  can  be 
rectified  by  recalling  the  patient  to  the  clinic.  The  recall  of  patients  is  not 
practical  in  a  retrospective  review  since  a  lengthy  time  lapse  between  treatment 
and  the  time  of  review  usually  has  occurred.  The  advantages  of  ease  of  record 
retrieval,  recall  of  patients,  and  prompt  correction  of  staff  deficiencies  denote  the 
concurrent  review  techniques  as  superior  to  retrospective  reviews  in  the  outpatient 
setting. 

In  addition  to  the  retrospective  and  concurrent  assessment  techniques,  the 
JCAH  refers  to  prospective  assessments.  The  prospective  aspects  of  quality 
assurance  deals  with  both  the  structure  of  patient  encounter  and  pre-establishment 
of  valid  assessment  criteria.  The  structural  system  has  been  discussed  previously 
as  well  as  the  development  of  explicit  criteria.  These  two  factors  are  important  in 
a  quality  assurance  program  but  without  the  concurrent  or  retrospective  review  the 


effectiveness  of  the  prospective  aspects  of  the  program  cannot  be  validated.  The 
prospective  methodology  cannot  stand  alone;  it  must  be  incorporated  into  the 
concurrent  or  retrospective  analysis. 

Conclusion 

The  need  for  quality  assurance  programs  is  not  going  to  vanish.  The  thrust  of 
outpatient  quality  assurance  should  be  on  the  process  of  the  patient  encounter. 
While  recognizing  the  importance  of  the  structure  and  outcome  portions  of  the 
ambulatory  care  system,  the  practitioners  should  insure  that  the  process  which 
they  can  directly  affect  is  optimal.  The  evaluation  of  the  care  provided  must  be 
based  on  clinically  valid  criteria.  Implicit  criteria  requires  an  extremely 
competent  reviewer  and  the  reliability  of  the  assessment  process  is  questionable. 
Explicit  criteria  enables  a  lesser  trained  individual  to  perform  audits  and  achieve 
superior  assessment  results. 

In  the  outpatient  setting,  the  inability  to  efficiently  and  quickly  retrieve 
patient  charts  mandates  the  use  of  concurrent  audit  techniques.  The  ability  to 
promptly  intervene  in  a  treatment  is  a  significant  positive  side  effect  of  the 
concurrent  audit. 

In  summary,  the  outpatient  quality  assurance  program  needs  to  focus  on  the 
process  of  the  patient  encounter,  using  explicit  criteria  on  a  concurrent  basis. 
These  principles  are  not  applicable  in  all  situations  but  any  individual  conducting  a 
study  would  be  wise  to  consider  their  application. 
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CHAPTER  III 


THE  PRESENT  AMBULATORY  CARE  QUALITY  ASSURANCE  PROGRAM 


General  Description  of  Outpatient  Services  at  DeWitt  Army  Community  Hospital 


DeWitt  Army  Community  Hospital  is  located  on  Fort  Belvoir,  Virginia  in  a 
geographical  region  which  encompasses  Virginia,  West  Virginia,  and  a  portion  of  the 
Washington,  D.C.  metropolitian  area.  It  is  a  120  bed  hospital  which  provides 
primary  care  to  a  population  of  approximately  85,000  beneficiaries.  The  hospital 
services  include:  family  practice,  general  surgery,  obstetrics  and  gynocology, 
orthopedics,  neurology,  outpatient  psychiatry  and  social  work,  pediatrics, 
dermatology,  physical  therapy,  ophthalmology  and  optometry,  internal  medicine, 
and  emergency  medicine.  The  hospital  has  one  residency  program  in  family 
practice  with  eighteen  residents  participating.  The  average  patient  census  is  97 
patients  per  day  and  an  average  of  three  births  occur  daily.  There  are  currently  82 
physicians  assigned  to  the  institution. 

The  hospital  operates  37  separate  clinics  which  together  treated  437,826 
patients  in  fiscal  year  1981.1  These  clinics  vary  greatly  in  location,  size,  and  type 
of  patients  seen.  The  Adolescent  Clinic  cared  for  1,303  teenagers  in  fiscal  year 
1981  and  the  Family  Practice  Clinic  cared  for  over  46,000  patients  in  the  same 
time  period.  In  addition  to  the  wide  variation  in  number  of  patients  seen,  the 
clinics  also  vai  y  greatly  in  location.  Many  of  the  clinics  are  based  in  the  confines 
of  the  main  hospital,  but  some  clinics,  such  as  Fort  A.P.  Hill  Health  Clinic,  45 
miles  south  of  Fort  Belvoir,  are  located  off  the  installation.  It  is  therefore 
difficult  to  identify  a  typical  clinic. 


The  responsibility  for  the  operation  of  the  clinics  within  the  hospital  is  divided 
(see  Figure  1).  The  Department  of  Medicine  is  responsible  for  those  clinics  which 
are  subordinate  to  the  department  such  as:  pediatrics,  neurology,  dermatology, 
internal  medicine,  and  cardiology.  The  Chief  of  Surgery  is  responsible  for  typical 
surgical  specialities:  general  surgery,  obstetrics  and  gynecology,  orthopedics, 
ophthalmology  and  optometry,  podiatry,  and  urology.  The  Department  of  Family 
Practice  is  responsible  for  not  only  the  family  practice  clinic,  but  also  the 
emergency  room,  physical  examination  clinic,  and  the  troop  health  clinics.  The 
troop  health  clinics  are  included  under  the  Chief  of  Family  Practice  because  the 
physicians  operating  these  clinics  are  family  practitioners.  Additionally,  the  Chief 
of  Family  Practice  is  responsible  for  the  off  post  health  clinics.  To  accommodate 
this  increased  responsibility,  the  Chief  of  Family  Practice  has  the  collateral  duty 
of  Director  of  Primary  Care  and  Community  Medicine. 

Outside  of  the  three  major  departments,  there  are  still  outpatient  clinics 
which  operate  under  a  variety  of  names.  The  Occupational  Health  Clinic  is 
supervised  by  an  autonomous  occupational  health  physician.  The  Chief  of  the 
Community  Mental  Health  Activity  is  responsible  for  the  operation  of  a  combined 
psychiatry/psychology/social  work  clinic.  To  further  complicate  the  situation,  all 
nursing  personnel  who  staff  the  clinics  (registered  nurses,  licensed  practical  nurses, 
corpsmen,  and  operating  room  technicians)  are  supervised  and  controlled  by  the 
Chief,  Department  of  Nursing. 

The  purpose  of  this  discussion  is  to  acquaint  the  reader  with  some  of  the 
variables  involved  in  discussing  the  ambulatory  care  facilities  at  DeWitt  Army 


Community  Hospital.  The  clinics  are  dispersed,  the  supervision  of  the  clinics  is  not 
centralized,  and  the  type  of  patients  seen  at  each  of  the  clinics  depends  upon  the 
speciality  of  that  clinic. 


Current  Ambulatory  Quality  Assurance  Activities 
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The  current  outpatient  quality  assurance  program  at  DeWitt  is  difficult  to 
define  since  there  is  a  complete  lack  of  direction  and  organization  to  the  process. 
When  approached  on  the  subject,  the  personnel  in  the  clinics  state  that  either  it  is 
not  done  or  some  type  of  medical  chart  review  is  being  conducted.  Those  doing 
chart  reviews  have  no  documentation  of  what  was  done,  what  was  found,  or  what 


action  was  taken  to  correct  deficiencies  noted.  The  Joint  Commission  on 
Accreditation  of  Hospitals'  basic  ground  rules  on  quality  assurance,  listed  below, 
state  that  a  QA  program  must: 

1.  Be  comprehensive, 

2.  Be  integrated, 

3.  Have  problem  priorization, 

4.  Be  cost  effective, 

5.  Be  reappraised  annually, 

6.  Be  problem  focused, 

7.  Have  clinically  valid  criteria, 

8.  Be  documented,  and 

9.  Have  follow-up  actions. 

These  nine  ground  rules  have  not  been  considered  in  performing  most  of  the  quality 
assurance  work  at  the  hospital.  There  is  an  exception  to  the  generally  bleak 


outpatient  quality  assurance  picture  at  DeWitt,  the  Department  of  Family 
Practice.  However,  the  efforts  in  that  department  are  a  recent  innovation. 


.1 


The  management  of  the  hospital  recognized  the  need  to  strengthen  the  quality 
assurance  program  in  the  fall  of  1980.  The  impetus  for  this  concern  was  an 
upcoming  accreditation  visit  by  the  Joint  Commission  of  Accreditation  of  Hospitals 
scheduled  for  April  of  1982.  The  administrative  resident  at  that  time  was  directed 
to  formulate  a  new  QA  plan  which  would  fulfill  the  January,  1981  JCAH  standards 
on  quality  assurance.  To  that  end  a  revised  plan  was  developed  (Appendix  A).  The 
plan  encompassed  all  the  facets  of  a  model  plan  which  the  JCAH  outlined  in  the 
Manual  for  Accreditation  of  Hospitals,  dated  1981.  The  organizational  structure 
was  activitated  prior  to  the  accreditation  and  quality  assurance  projects  began  to 
flow. 

Subsequent  to  the  accreditation  visit,  the  flow  of  problems  slowed  to  a  trickle. 
The  reason  for  this  can  be  linked  to  several  key  factors.  First  the  plan,  although 
technically  correct,  was  not  a  tool  which  the  practitioners  could  use  as  a  ready 
reference.  The  format  for  submitting  problems  (DA  Form  2496,  Appendix  B) 
required  a  great  deal  of  information,  and  was  cluttered.  The  chart  which  described 
the  flow  of  information  (Figure  2)  did  not  present  a  clear  picture  of  the  quality 
assurance  process. 

Another  reason  for  the  failure  of  the  plan  can  be  traced  to  the  management  of 
the  program,  the  Hospital  Executive  Committee.  This  committee  is  composed  of 
the  Hospital  Commander,  the  Executive  Officer,  the  Chief  of  Professional 
Services,  and  the  Chief,  Department  of  Nursing.  The  committee  was  to  serve  as 
the  Quality  Assurance  Committee  for  the  institution.  It  became  quickly  obvious 
that  the  QA  activities  of  the  hospital  were  not  being  properly  monitored  by  the 
Executive  Committee.  The  jolt  which  led  to  that  realization  was  the  reoccurring 
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comment  on  all  the  committee  minutes  reviewed  of,  "No  quality  assurance 
problems  noted."  This  resulted  in  a  decision  that  another  structure  had  to  be 
developed  to  oversee  the  QA  program. 

In  order  to  reevaluate  the  process  to  establish  a  more  viable  structure, 
meetings  with  the  hospital  leadership  were  conducted.  The  results  of  those 
meetings  were: 

1.  The  medical  and  administrative  staff  did  not  want  to  participate  in 
another  committee. 

2.  The  focus  of  the  QA  program  would  be  at  the  departmental  level,  with  the 
department  chief  having  the  decentralized  responsibility  to  conduct  the  QA 
program  at  his/her  level. 

In  order  to  include  the  recommendations  of  the  majority,  the  plan  was 
rewritten  (Appendix  C).  The  revision  included  the  formation  of  a  Quality 
Assurance  Coordinating  Committee  to  oversee  the  QA  activities  of  the  hospital. 
To  reduce  time  demands  on  the  staff  of  the  hospital,  the  membership  was  limited 
to: 

1.  Chief,  Professional  Services  (Chairman), 

2.  Department  of  Nursing  QA  Coordinator, 

3.  Chief,  Inpatient  Branch,  Clinical  Support  Division, 

4.  Risk  Manager,  and 

5.  Administrative  Resident. 

The  issue  of  departmental  centered  QA  activities  was  included  in  the  plan  by 
specifically  challenging  the  departments  to  develop  a  QA  plan  for  their 
organization  and  requiring  reports  on  their  activities. 
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The  revised  plan  simplified  the  reporting  procedures  and  attempted  to  place 
the  monitoring  responsibility  on  a  committee  (the  QA  Coordinating  Committee) 
better  suited  to  perform  the  detailed  supervision  needed. 

The  quality  assurance  activities  performed  in  the  hospital's  outpatient 
activities  are  minimal.  The  Department  of  Family  Practice  is  the  current 
pacesetter  in  performing  outpatient  quality  assurance  studies.  This  department  has 
not  only  the  family  practice  clinic  under  its  control,  but  is  also  responsible  for  the 
troop  health  clinics,  health  clinics  at  Fort  A.P.  Hill  and  Vint  Hill  Farms  Station, 
the  emergency  treatment  room,  the  acute  minor  illness  clinic,  and  the  flight 
surgeons'  clinic. 

The  Department  of  Family  Practice  conducted  a  study  in  the  emergency  room 
on  corneal  abrasions.  The  results  of  this  study  (Appendix  D)  revealed  a  basic 
understanding  of  audit  procedures,  but  the  format  did  not  identify  individual 
providers  whose  practice  was  unacceptable.  Although  incomplete,  the  study 
resulted  in  new  protocols  and  training  sessions  to  correct  shortcomings.  A  follow¬ 
up  study  (Appendix  E)  showed  some  improvement  in  the  quality  of  care  provided  for 
that  specific  diagnosis. 

The  reason  for  the  family  practice  department's  QA  program  is  not  entirely 
self-motivated  by  the  department's  personnel.  The  department  is  responsible  for 
an  accredited  residency  program  and  in  order  to  fulfill  the  accreditation  standards 
the  department  must  have  a  viable  QA  program.  The  family  practice  QA  plan  does 
not  directly  address  the  monitoring  of  individual  physician  practice.  The 
identification  of  deficiencies  on  a  departmental  level  may  be  inappropriate  if  one 
or  two  practitioners  are  responsible  for  the  majority  of  the  deficiencies.  The 


monitoring  of  the  quality  of  care  provided  should  extend  to  the  individual 
physician.  This  is  particularly  true  in  a  teaching  program  if  a  resident's  ability  is 
to  be  objectively  assessed. 

Beyond  the  family  practice  department's  efforts,  the  efforts  of  the  hospital 
are  not  very  effective.  The  quality  of  care  rendered  in  the  Acute  Minor  Illness 
Clinic  (AMIC)  is  required  to  be  monitored  by  the  program  document  which 
prescribes  daily  audits  of  the  enlisted  personnel  who  are  physican  extenders. 2  This 
audit  is  to  insure  that  the  extenders  are  complying  with  the  algorithms  which 
prescribe  diagnostic  and  treatment  regimens  for  an  array  of  common  diagnoses  and 
patient  physical  complaints.  This  mandatory  review  of  10%  of  the  cases  seen  daily 
is  excellent  for  insuring  program  maintenance  but  does  not  evaluate  the  efficacy  of 
care  other  than  that  which  is  prescribed  in  the  extenders  manual. 

The  Ambulatory  Care  Committee,  comprised  of  providers  of  ambulatory  care, 
conducts  semi-annual  audits  of  outpatient  care  as  mandated  by  Standard  VI  of  the 
JCAH.  The  results  of  those  audits  have  not  been  widely  disseminated  or  intergrated 
into  other  quality  assurance  activities  in  the  institution. 

The  Chief  of  Emergency  Services,  in  conjunction  with  the  Chief  of  Pediatric 
Service,  has  instituted  a  daily  review  of  all  pediatric  patients  seen  in  the 
emergency  room  during  the  previous  evening  and  night.  The  thrust  of  this  review  is 
to  survey  the  appropriateness  of  care  provided  by  the  emergency  room  staff.  This 
daily  audit  allows  the  pediatric  staff  to  contact  the  patients  if  they  feei  that 
additional  care  needs  to  be  rendered.  The  shortcoming  with  the  system  is  that  a 
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methodology  for  trending  problems  which  are  cither  generally  applicable  to  all 
providers  or  are  attributable  to  an  individual  provider  is  needed.  This  lack  of 
feedback  invites  a  constant  repetition  of  the  problems. 


The  Medical  Care  Evaluation  Committee  of  the  hospital  is  responsible  for  a 
number  of  monitoring  activities  associated  with  quality  assurance  and  utilization 
review.  Specific  to  outpatient  care  is  a  chart  review  process  whereby  a  random 
sample  of  approximately  30  records  is  provided  to  each  of  the  major  departments 
(surgery,  medicine  and  family)  as  well  as  pediatrics,  obstetrics  and  gynecology 
service.  The  chief  of  each  of  these  departments/services  conducts  a  review  of  the 
last  visit  annotated  in  the  patient's  record.  There  is  no  criteria  for  commonality  of 
the  record  except  that  the  last  visit  must  be  in  the  service  within  the  preceding 
ninety  days.  The  chief  reviews  the  chart  based  upon  his  knowledge  arid  reports 
findings  to  the  committee  in  a  round  table  fashion.  The  findings  are  typically 
negative.  A  review  of  the  committee  minutes  revealed  a  complete  lack  of  action 
resulting  from  this  type  of  audit. 

Summary  of  Current  Quality  Assurance  Activities 
The  current  outpatient  quality  assurance  process  at  DeWitt  Army  Community 
Hospital  is  not  coordinated.  There  are  clusters  of  outpatient  QA  activities 
performed,  but  their  results  are  not  intergrated  into  a  hospital  wide  program.  The 
information  gained  by  one  study  is  not  shared  with  other  providers  in  the 
institution.  The  institution  lacks  a  sense  of  direction  in  the  assurance  of  outpatient 
care. 

The  lack  of  direction  is  due  in  part  to  the  inexperience  of  the  professional 
staff  in  performing  QA  studies.  The  retrospection  audits  performed  during  the 


1970's  were  conducted  primarily  by  medical  records  technicians  and  were  basically 
ineffective.  The  idea  of  starting  an  audit  process  for  outpatient  care  is 
unwelcomed  by  many  physicians  and  this  feeling,  coupled  with  a  general  lack  of 
knowledge  of  quality  assurance  techniques,  e.  g.,  concurrent  audits,  generic  audits, 
and  process  versus  outcome  audits,  presents  a  significant  challenge  to  the  hospital 
leadership. 

The  fundamental  problem  with  the  QA  program  is  a  lack  of  understanding  by 
the  medical  staff  of  what  QA  is.  The  nonproductive  chart  audits  conducted  by  the 
Medical  Care  Evaluation  Committee  typifies  the  utter  futility  of  the  current  QA 
program.  This  paper  will  discuss  the  primary  responsibilities  of  the  hospital  staff 
in  the  QA  program.  They  are; 

1.  Problem  identification, 

2.  Criteria  development, 

3.  Documentation,  and 

4.  Follow-up. 

The  next  chapter  will  address  each  of  the  responsibilities. 
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l^oint  Commission  on  Accreditation  of  Hospitals,  Manual  for  Accreditation  of 
Hospitals,  (Chicago,  1982). 

2US  Army  Health  Services  Command,  Ambulatory  Patient  Care  Model  #13, 
dated  August,  1977,  Fort  Sam  Houston,  Texas. 


CHAPTER  IV 


PROPOSED  PROGRAM 

As  discussed  in  the  preceding  chapter,  the  professional  staff  does  not  desire  to 
participate  in  an  additional  committee.  The  QA  Coordinating  Committee  monitors 
the  actions  of  the  existing  committee  structure  and  departmental  level  QA 
activities.  In  order  to  assist  department  chiefs  and  the  committee  chairpersons  in 
fulfilling  their  QA  responsibilities,  a  well  defined  program  must  exist.  The 
program  must  facilitate  meaningful  actions  with  a  minimal  amount  of  professional 
time  expenditure.  This  chapter  is  designed  to  outline  a  program  so  that  individuals 
responsible  for  QA  actions  can  fulfill  the  intent  of  the  JCAH  QA  standards. 

Program  Structure 

The  process  of  a  QA  program  includes  a  number  of  requirements  to  insure 
thoroughness  and  effectiveness.  As  outlined  by  the  3CAH,1  a  q/\  program  must: 

1.  Be  comprehensive, 

2.  Be  intergrated, 

3.  Have  problem  prioritization, 

4.  Be  cost  effective, 

5.  Be  reappraised  annually, 

6.  Be  problem  focused, 

7.  Have  clinically  valid  criteria, 

8.  Be  documented  and, 

9.  Have  follow-up  actions. 


In  addition  to  these  nine  requirements,  the  JCAH  specifies  various 
audits/reviews  for  the  hospital  services.  These  37  required  QA  actions  are  listed  in 


Appendix  C. 

The  revised  hospital  QA  plan  (Appendix  C)  includes  as  Annex  A,  a  chart  of  the 
QA  organization  (see  Figure  3,  next  page).  The  first  five  requirements  can  be 
viewed  as  a  responsibility  shared  by  the  QA  Coordinating  Committee  and  the 
Executive  Committee.  The  last  four  issues  are  of  primary  concern  to  the  reporting 
activities. 

The  program  outlined  in  the  revised  hospital  QA  plan  (Appendix  C)  provides 
the  basic  framework  for  a  viable  program.  The  major  concern  is  that  quality 
assurance  studies  have  not  been  initiated  at  the  reporting  level.  Only  in 
anticipation  of  the  accreditation  visit  by  the  Joint  Commission  on  Accreditation  of 
Hospitals  did  the  flow  of  quality  assurance  studies  begin.  Since  the  time  of  the 
survey  (June,  1981)  to  the  present  only  five  quality  assurance  studies  have  been 
instituted. 2  Of  the  five  studies,  three  are  applicable  to  the  outpatient  setting. 

To  have  an  effective  ambulatory  care  quality  assurance  program,  emphasis 
must  be  placed  on  the  four  primary  responsibilities  of  the  report  activities:  1) 
problem  identification,  2)  clinically  valid  criteria,  3)  documentation,  and  4)  follow¬ 
up. 

Problem  identification 


The  literature  constantly  refers  to  an  elaborate  listing  of  sources  for 
identification  of  quality  assurance  problems.^*  ^  The  list  encompasses: 
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ANNEX  A 


I.  Organization  RESPONSIBILITY  FOR  QA 

REQUIREMENTS 
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II.  Composition  of  QA  Coordinating  Committee 


Chief,  Professional  Services  (CPS)  Chairman 

Risk  Manager  Member 

Nursing  QA  Coordinator  Member 

,,  Chief,  Inaptient  Care  Branch  Member 

Administrative  Resident  Member 

Secretary  to  the  CPS  Recorder 


FIGURE  i 
32 


\  I.  '■  ■>  *  ,  »*  r  i  ••  'A  V  :  s .  -tj  r,  I rj  *~H  K\.  >r.  V.  <%  it.  ■'« r.  <v KVf 


1.  Utilization  Review  Data, 

2.  Morbidity  Review, 

3.  Mortality  Review, 

4.  Tissue  Review, 

5.  Antibiotic  Committee  Results, 

6.  Therapeutics  Agents  Board  Results, 

7.  Blood  Utilization  Committee, 

8.  Infectious  Disease  Committee, 

9.  Unusual  Occurence  Report, 

10.  Safety  Committee, 

11.  Outside  Audit  Agencies,  e.g.,  JCAH,  Army  Audit  Agency,  General 
Accounting  Office,  and 

12.  Credentials  Committee. 

Interviews  with  the  professional  staff  of  the  hospital  reveal  that  many  of  the 
above  listed  sources  of  information  are  not  being  used  to  formulate  quality 
assurance  studies.  ^  6  A  reason  for  this  is  a  lack  of  demand  to  conduct  quality 
assurance  studies. 

For  example,  a  review  of  minutes  of  the  tissue,  infectious  disease  control, 
blood  utilization,  and  morbidity  committees  shows  that  a  standard  agenda  is 
followed  and  results  are  predictable.  Variations  noted  in  the  discussion  are 
explained  and  typically  no  recommendations  are  made  concerning  problems  noted. 
In  order  to  correct  this  situation,  guidance  to  the  committee  chairpersons 
mandating  problem  identification  is  needed.  The  Chief,  Emergency  Medical 
Services,  stated  that  it  would  be  helpful  in  formulating  studies  to  have  more 


information  from  the  laboratory  on  problems  emanating  from  his  department. 7  A 
follow-up  interview  with  Major  Ridenour,  Assistant  Chief,  Department  of 
Pathology,  established  that  it  is  possible  to  identify  trends  in  apparent 
inappropriate  use  of  laboratory  tests. 8  This  failure  in  communications  is  due  to  the 
lack  of  a  concentrated  effort  on  the  part  of  various  departments  and  services  to 
surface  problems. 

The  professional  staff  of  the  outpatient  clinics  requires  information  not  only 
on  what  types  of  patients  they  treat  but  also  on  how  the  treatment  of  patients 
affects  other  activities  within  the  hospital.  In  an  effort  to  correct  this  situation, 
the  revised  hospital  quality  assurance  (Appendix  C)  has  placed  an  emphasis  on 
departmental/separate  service  quality  assurance  activities.  By  requiring  separate 
services  and  departments  to  report  their  quality  assurance  efforts  monthly  to  the 
Quality  Assurance  Coordinating  Committee,  a  portal  for  expression  of  both  intra 
and  interdepartmental  problems  is  opened.  The  identification  of  a  problem  in  other 
services  via  the  interdepartmental  problem  identification  format  leads  to  increased 
departmental  interaction.  A  collegiality  must  exist  among  staff  members  to 
effectively  deal  with  these  types  of  problems.  Heretofore,  waiting  for  staff 
members  to  voluntarily  identify  problems  has  not  resulted  in  any  action.  The 
author  noted  that  the  majority  of  interdepartmental  action  arose  from  possibly 
disastrous  incidents.  Responses  are  normally  hasty  and  although  the  results  may  be 
appropriate,  waiting  for  a  crisis  to  identify  a  problem  is  not  consistent  with  modern 
management  practices. 

In  addition  to  problems  identified  by  committees,  services  or  departments, 
there  are  other  sources  of  information  available  to  identify  problems.  Dr.  Stanley 


Skillicorn  in  his  book,  Quality  and  Accountability,  elaborates  on  the  need  to 
identify  problems  from  both  official  and  unofficial  sources.  The  official  sources 
are  comprised  of  necessary  reports,  statistical  summaries,  and  minutes  of 
meetings.  Although  these  documents  include  many  important  facts  which  pinpoint 
quality  assurance  problems,  the  institution  must  recognize  unofficial  information 
as  an  important  source  of  problem  identification. 

The  problem  with  unofficial  information  is  capturing  it.  At  some  point  an 
individual  must  locate  the  problem  and  communicate  the  concern  to  an  individual 
who  will  act  on  it.  Verbalizing  the  problem  is  not  adequate.  At  some  juncture  the 
unofficial  information  needs  to  be  transformed  into  writing,  making  it  official.  At 
the  present  time  patient  complaints  are  transmitted  to  the  patient  representative 
via  spoken  word  or  in  writing.  In  either  case  the  complaint  is  eventually  recorded 
on  a  Concerned  Care  Comment  (Appendix  F). 

The  complaints  are  handled  on  an  individual  basis  with  a  written  reply  sent  to 
the  patient.  The  total  number  of  complaints  is  catagorized  monthly  and  used  as 
the  basis  for  a  monthly  patient  representative  report  (Appendix  G).  The  report  is 
reviewed  by  the  hospital  staff  and  the  resultant  action  is  sporadic.  Changes 
resulting  from  the  report  have  been  made  in  patient  waiting  times  in  the 
emergency  treatment  room  and  pharmacy.  Also,  several  indepth  studies  of  the 
central  appointment  system  have  been  conducted.  The  concerns  patients  convey 
are  acted  upon  individually  and  in  a  number  of  cases  have  produced  changes. 
Although  improvement  has  occurred,  the  system  could  be  more  productive. 

The  format  of  the  current  patient  representative  report  is  typical  of  many  of 
the  documents  which  convey  hospital  status.  The  infectious  disease  report  and 
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unusual  occurence  report  are  other  quality  of  care  indicators  that  can  be  used  more 
effectively  in  problem  identification.  These  reports  provide  a  point  in  time  status 
of  the  indicator,  e.g.,  the  number  of  patient  complaints  during  the  previous  month. 
The  actual  number  would  be  more  meaningful  if  there  was  a  basis  of  comparison. 
An  example  is  the  patient  complaints  viewed  as  a  function  of  the  total  outpatient 
visits.  By  recovering  historical  data  regarding  the  number  of  outpatient  visits  and 
the  complaints  by  month,  a  trend  line  can  be  developed. 

The  concept  of  trending  can  be  applied  to  any  quality  of  care  indicator  which 
can  be  correlated  to  an  independent  variable.  Possibilities  include  medication 
errors  per  inpatient  days,  radiographic  retakes  per  total  radiographic  procedures, 
or  post  operative  infections  per  total  episodes  of  surgery.  While  developing  a  trend 
line,  prediction  intervals  can  also  be  determined.  These  intervals  are  a  range  of 
values  from  which  a  band  of  expected  values  can  be  developed.  By  graphing  the 
trending  line  and  the  band  of  expected  values,  the  analyst  has  an  effective  tool  to 
display  reporting  statistics.  An  example  of  such  a  graph  is  on  the  following  page 
(Figure  *+).  By  utilizing  trending  as  a  management  tool,  the  quality  assurance 
reviewing  officials  can  concentrate  on  pinpointing  sources  of  identified 
abnormalities  rather  than  deciphering  the  relevance  of  the  reported  information. 

The  patient  advocate  gives  the  patient  a  voice  in  formulating  policy  change 
but  the  staff  lacks  a  similar  conduit  to  express  concerns.  To  rectify  this  situation, 
a  system  for  individual  expression  of  possible  quality  assurance  problems  needs  to 
be  defined.  The  form  included  in  the  revised  hospital  quality  assurance  plan 
(Appendix  H),  MEDDAC  Form  522,  Quality  Assurance  Program  Problem 


Corarjaints 


Assessment  Worksheet,  has  the  potential  to  allow  individual  initiation  of  problem 
identification.  The  solicitation  of  individual  initiatives  needs  the  support  of  the 
hospital  leadership.  A  non-retribution  policy  needs  to  be  extended  to  those  who 
step  forward  to  reveal  a  problem.  An  open  invitation  to  all  staff  members  to 
provide  input  to  the  program  should  uncover  potential  problems.  The  handling  of 
problems  requires  tact  on  the  part  of  the  quality  assurance  chairman.  Positive 
reinforcement  of  those  who  contribute,  no  matter  how  mundane  the  subject,  should 
be  the  tone. 

If  the  situation  arises  whereby  the  department/committee  level  QA  activities 
are  unable  to  identify  problems  from  any  of  the  sources  already  discussed  then  the 
activity  should  take  actions  to  discover  problems.  Medical  records  auditing  is  a 
viable  technique  in  detecting  QA  problems.  A  review  of  medical  records  can 
reveal  problems  which  might  go  undetected.  A  logical  approach  would  be  to  review 
selected  charts  based  on  prevalence  of  either  a  diagnosis  or  a  medical  complaint. 

To  determine  the  most  prevalent  diagnosis/chief  complaint,  a  survey  was 
conducted  for  a  one  week  period  in  four  large  outpatient  activities.  The  activities 
were:  (l)  Obstetrics  and  Gynecology  Clinic,  (2)  Acute  Minor  Illness  Clinic,  (3) 
South  Post  Health  Clinic,  and  (4)  Family  Practice  Clinic.  These  clinics  were 
selected  because  they  represent  a  cross  section  of  the  patient  population  treated. 

The  survey  document  (Appendix  I)  required  the  clinic  personnel  to  catagorize 
and  record  the  chief  complaint  and  diagnosis  of  patients  seen.  The  tabulation  of 
the  data  provided  the  clinic  chief  an  assessment  of  the  variety  of  ailments  and 
diagnoses  treated  in  that  particular  setting.  The  results  of  the  survey  are  depicted 
in  Appendices  1.1,  1.2,  1.3,  and  1.4. 
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From  this  information  a  plan  can  be  developed  for  performing  studies  to 
evaluate  the  quality  of  care  provided  based  on  the  prevalence  of  the 
diagnosis/chief  complaint.  The  rank-order  assessment  of  diagnosis/chief  complaint 
provides  the  clinicians  with  a  logical  basis  to  formulate  a  QA  plan  in  the  absence  of 
other  stimuli. 

Carrying  the  survey  of  the  clinics  to  all  thirty-seven  clinics  in  the  hospital 
furnishes  the  institution  with  a  snapshot  of  the  types  of  complaints  and  diagnoses 
seen  by  the  hospital  on  the  aggragrate.  Referring  to  the  JCAH  standard  on  quality 
assurance,  hospital-wide  priorities  are  required. ^  A  compilation  of  total  number  of 
patients  seen  for  a  specific  diagnosis  in  all  clinics  supplies  a  basis  for  decision 
making  on  assignment  of  those  priorities. 

Clinically  Valid  Criteria 

The  development  of  criteria  is  fundamental  to  the  quality  assurance  process. 
An  objective  of  this  study  is  to  enable  paraprofessional  personnel  to  perform  the 
bulk  of  the  audit  process.  In  order  for  this  goal  to  be  achieved,  the  development  of 
explicit  audit  criteria  must  be  accomplished.  Discussions  with  various  clinic  chiefs 
did  not  produce  a  concensus  in  this  area.  The  clinics  with  fulltime  hospital  staff 
assigned  agree  that  paraprofessional  personnel  can  perform  chart  audits  with 
certain  reasonable  limitations.  However,  in  the  troop  clinics,  the  professional 
staff  conducts  the  audit  process  because  of  constant  personnel  turnover 
problems. 

Even  in  those  clinics  which  have  the  paraprofessional  staff  available  to 
conduct  chart  audits,  the  professionals  directing  the  study  should  insure  that  the 
paraprofessionals  understand  the*  audit  criteria  and  have  a  point  of  contact  for 


resolution  of  problems.  The  physicians  who  establish  the  criteria  need  to  recognize 
the  possibility  of  exceptions  and  have  those  charts  which  do  not  fit  the  mold 
referred  to  a  professional  for  resolution. 


)ocumentation 


The  documentation  of  QA  activities  is  critical  in  the  accreditation  process. 
The  JCAH  survey  team  is  only  able  to  base  its  decision  on  the  effectiveness  of  a 
quality  assurance  program  on  the  files  and  records  available.  The  documentation 
phase  represents  a  sizable  investment  of  manpower.  In  documenting  a  QA  study, 
four  separate  subjects  must  be  addressed: 

1.  Identification  of  information  sources, 

2.  Methods  of  capturing  information, 

3.  Data  manipulation,  and 

4.  Conclusion  development  based  on  data  analysis. 

A  discussion  of  each  follows. 

Identification  of  Information  Sources 

The  discussion  with  the  clinicians  in  the  outpatient  setting  reveals  a  need  for 
more  complete  information  to  assess  the  quality  of  care  provided.  Identification  of 
information  sources  is  the  next  order  of  business.  A  source  of  information  is  the 
Patient  Administration  System  and  Biostatistical  Agency,  (PASBA)  IJS  Army 
Health  Services  Command,  Fort  Sam  Houston,  Texas.  The  PASBA  is  the  single 
manager  for  all  automated  biostatistical  information  for  the  US  Army.  This 
organization  compiles  a  tremendous  volume  of  information  on  patients  treated  in 


Army  hospitals.  However,  a  discussion  with  Lieutenant  Colonel  Arthur  Badgett, 
Chief,  Biostatistical  Division  of  the  agency,  revealed  that  the  vast  majority  of  the 


information  captured  is  on  patients  admitted  to  the  hospital. H  The  only  data 
available  on  outpatients  is  the  number  of  clinic  visits  and  the  catagory  of 
beneficiary,  e.g.,  active  duty,  dependent  of  active  duty,  retiree,  etc.  The  data 
available  at  the  PASBA  is  also  locally  available  and  does  not  appear  to  be  helpful. 

LTC  Badgett  recognized  the  lack  of  automated  information  as  a  problem  in 
monitoring  quality  assurance.  Currently,  experiments  are  being  conducted  at 
various  Army  hospitals  to  determine  if  it  will  be  feasible  in  the  future  to  capture 
outpatient  treatment  data.  The  high  volume  of  outpatient  visits  within  the  Army 
makes  this  task  extremely  difficult.  LTC  Badgett's  prognosis  for  automated 
support  in  outpatient  services  is  not  optimistic;  an  automated  system  is  at  least 
five  years  in  the  future.  Obviously,  the  quality  assurance  program  cannot  wait  for 
automated  data  collection. 

Without  support  from  the  PASBA  the  hospital  will  have  to  rely  on  locally 
available  data.  The  heart  of  the  hospital  data  collection  is  the  Patient 
Administration  Division.  This  information  source  has  the  responsibility  for 
maintenance  of  all  outpatient  medical  records  of  patients  treated  at  the  hospital. 
Currently,  the  division  is  maintaining  in  excess  of  75,000  outpatient  records.^ 
Army  outpatient  treatment  records  are  kept  in  a  chronological  sequence,  the  most 
recent  encounter  is  the  last  entry  in  the  record  and  is  the  top  document  in  the  file. 
The  size  of  the  record  depends  on  the  number  of  times  the  patient  is  treated.  The 
record  can  be  perpetual  and  the  same  record  may  contain  forty  years  worth  of 
data.  The  only  time  an  outpatient  treatment  record  is  retired  is  when  the  patient 
has  not  been  seen  within  the  last  three  years.  Even  if  the  record  is  retired,  it  is 
forwarded  to  the  records  storage  area  in  St.  Louis,  Illinois  and  held  for  no  less  than 
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25  years. ^  The  outpatient  medical  record  is  the  single  most  valuable  source  of 
information  for  evaluation  of  quality  of  care  in  the  institution.  The  evaluation  is 
determined  from  the  notes  made  by  the  provider  in  conjunction  with  the  results  of 
tests  performed.  Since  the  completeness  of  the  record  is  a  key  factor  considered 
by  the  Joint  Commission,  the  record  should  also  be  the  primary  focus  of  local 
quality  assurance  activities. 

The  outpatient  medical  record  contains  many  different,  types  of  data.  The 
most  common  elements  of  the  outpatient  record  include  laboratory  results,  x-ray 
results,  copies  of  physical  examinations,  summaries  of  inpatient  episodes,  and 
narrative  descriptions  of  outpatient  visits.  The  quality  of  the  record  depends  on 
the  individuals  who  contribute  to  the  body  of  the  record.  The  laboratory  and  other 
departments  are  responsible  for  insuring  that  copies  of  all  tests  are  forwarded  to 
the  outpatient  records  room  for  posting  to  the  record.  Herein  lies  a  tremendous 
problem.  In  order  to  post  results,  the  record  must  be  in  the  records  room.  A 
complete  record  depends  upon  all  the  steps  or  stages  of  the  process  being  in 
coordination;  if  any  one  of  the  components  fails,  the  result  is  an  incomplete  record. 

The  laboratory,  pharmacy  and  radiology  departments  are  additional 
information  sources  which  maintain  individual  records  of  their  portion  of  a  patient 
encounter.  Individual  copies  of  each  laboratory  test  and  x-ray  examination  are 
maintained  by  the  Department  of  Pathology  and  the  Department  of  Radiology.  The 
pharmacy  maintains  copies  of  all  prescriptions  filled  in  that  service.  These  copies 
provide  the  chief  of  each  service  a  key  to  assessing  the  quality  of  services  and  the 
appropriateness  of  requested  tests  or  prescriptions. 
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The  Patient  Administration  Division,  as  mentioned  earlier,  maintains  the 
medical  records  for  patients  treated  at  the  hospital.  Because  of  its  responsibility 
to  post  all  information  to  the  record,  the  Patient  Administration  Division  is  most 
capable  of  assessing  the  status  of  the  composition  of  the  record. 

The  biggest  issue  in  assessing  outpatient  care  is  the  unavailability  of  the 
record  which  can  be  attributed  to  a  variety  of  problems.  There  are  problems  with 
individual  patients  maintaining  their  own  records,  clinics  not  promptly  returning 
records,  and  records  being  misplaced.  Any  one  of  these  situations  can  seriously 
affect  the  ability  to  conduct  audits  and/or  studies.  In  order  to  have  a  viable 
program,  the  Patient  Administration  Division  needs  to  support  the  audit 
procedures.  The  most  important  data  the  division  provides  is  on  the  administrative 
actions  required  to  maintain  the  complete  outpatient  health  record.  Specific  data 
should  include  time  required  for  clinics  to  return  records  after  a  patient 
appointment,  percentage  of  records  not  maintained  in  the  outpatient  records  room, 
total  number  of  test  results  for  which  a  medical  record  has  to  be  constructed,  and 
other  measurements  of  completeness  of  the  outpatient  medical  record. 

Another  information  source,  the  Uniform  Chart  of  Accounts  Branch  of  the 
Comptroller  Division,  amasses  a  tremendous  amount  of  data  regarding  the 
operation  of  the  hospital.  The  problem  with  the  data  compiled  is  that  it  is  not 
useful  to  the  management  of  the  hospital  in  decision  making.^  Although  the 
results  of  the  sophisticated  step  down  cost  apportionment  methodology  do  not 
provide  a  usable  end  product,  the  data  base  upon  which  the  system  is  based  is  a 
handy  resource  to  the  organization.  With  very  little  effort  the  Uniform  Chart  of 
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Accounts  Branch  can  provide  an  extract  of  almost  any  type  of  data  a  manager 
needs  to  evaluate  the  cost  of  operating  a  service  and  also  the  amount  of  workload 
generated  by  that  service. 

It  is  inappropriate  to  expect  QA  problems  to  be  identified  by  the  Uniform 
Chart  of  Accounts  Office.  The  data  bank  should  be  used  as  a  resource  in 
confirming,  analyzing  and  evaluating  problems  which  involve  resources.  By 
soliciting  historical  data  from  the  Uniform  Chart  of  Accounts  Office,  the  person 
conducting  the  study  may  be  able  to  gather  more  complete  information  upon  which 
to  judge  his/her  decision. 

Methods  of  Capturing  Information 

Capturing  data  for  the  outpatient  quality  assurance  program  must  be 
accomplished  in  a  manual  mode.  The  hospital  is  totally  lacking  in  automation  in 
the  primary  care  setting.  The  lack  of  automation  does  not  mean  that  data  is 
unobtainable.  To  determine  the  optimal  point  during  the  patient  encounter  to 
collect  the  data,  some  preliminary  decisions  must  be  made.  The  subject  or  focus  of 
the  study  needs  to  be  determined.  The  focus  may  be  on  a  diagnosis,  a  chief 
medical  complaint,  a  category  of  patient  (age,  sex,  race),  a  particular  laboratory 
test,  an  administrative  procedure,  or  a  patient's  diet.  After  the  subject  is  selected, 
the  next  decision  is  what  will  be  measured,  counted,  examined,  or  compared  by  the 
data  collector.  This  needs  to  be  clearly  defined  to  insure  consistent  results. 

The  volume  of  data  to  be  collected  must  also  be  considered.  The  high  cost  of 
data  collection  warrants  the  use  of  sampling  techniques  (see  Appendix  3  for  further 
discussion). 


When  the  optimal  data  collection  point  is  determined,  the  development  of  data 
collection  forms  facilitates  the  recording  of  information.  In  the  audit  setting 
certain  information  must  be  recorded  for  analysis.  This  information  includes: 

1.  Provider  identification. 

2.  Criteria  identification. 

3.  Patient  identification.  In  concurrent  audits,  identifing  the  patient  whose 
record  is  being  audited  is  critical.  One  of  the  primary  advantages  of  concurrent 
audits  is  the  potential  to  quickly  identify  deficient  patient  care  and  to  take 
corrective  actions  to  ameliorate  the  situation.  Therefore,  the  identity  of  each 
audited  record  is  important. 

4.  Criteria  evaluation  findings.  The  audit  results  should  be  recorded  so  that 
a  reviewing  official  can  identify  the  source  of  problems.  This  involves  the  results 
of  the  provider's  performance  in  each  criteria,  the  provider's  aggregate 
performance,  and  the  review  of  compliance  based  on  individual  criteria  and 
composite  criteria. 

The  individual  provider  audit  matrix  (Figure  5)  is  an  example  of  a  standard 
format  for  the  collection  of  data.  The  auditor  can  record  the  required  information 
described  previously.  The  space  alioted  for  the  provider  identification  should  be 
coded  to  protect  the  anonymity  of  the  provider  and  the  key  to  the  code  should  be 
safeguarded.  The  patient  identification  data  needs  to  include  the  data  that  is 
essential  to  retrieve  the  record: 

-beneficiary  code, 

-last  four  digits  of  the  social  security  account  number,  and 

-the  patient's  last  name. 
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This  data  is  contained  on  the  medical  records  folder  and  is  essential  for  the 
medical  records  branch  to  retrieve  the  chart.  The  column  on  the  left  side  of  the 
form  enables  the  auditor  to  list  the  audit  criteria. 

The  remainder  of  the  matrix  allows  the  auditor  to  record  the  outcome  of  each 
evaluation  of  the  patient's  chart  with  respect  to  the  criteria.  The  scoring  system 
for  the  criteria  depends  on  the  desires  of  the  audit  protocols  or  auditor's 
preference.  A  simple  scoring  system  is  1  =  compliance,  0  =  noncompliance.  This 
basic  scoring  system  can  be  expanded  to  meet  the  desires  of  the  auditor.  For 
example,  in  the  corneal  abrasion  study  discussed  earlier,  the  values  assigned  were: 
1  =  full  compliance,  J4  =  partial  compliance,  0  =  noncompliance.  The  scoring 
system  decided  upon  should  be  used  consistently  in  the  initial  and  any  follow-up 
studies. 

At  the  completion  of  the  audit,  the  individual  provider  audit  results  are 
totaled.  The  totals  for  the  rows  and  columns  should  be  identical  and  those  values 
should  be  entered  in  the  appropriate  block  in  the  bottom  right  portion  of  the 
worksheet.  At  this  point  the  auditor  can  review  the  performance  of  the  individual 
provider  by  either  criteria  or  individual  patient  results.  The  statistical  tests  can  be 
employed  to  analyze  the  results. 

When  more  than  one  provider  has  been  audited,  the  worksheet  shown  on  the 
following  page  (Figure  6,  Summary  Audit  Matrix)  enables  the  totals  of  the 
individual  provider's  worksheets  to  be  recorded.  To  complete  this  worksheet,  the 
auditor  transfers  the  information  on  the  individual  worksheet  to  the  summary 
matrix.  The  provider  code  block  is  completed  with  the  same  provider  code  as  used 
on  the  individual  worksheets.  The  actual  and  possible  figures  for  each  criteria  are 
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transcribed  to  the  summary  matrix.  The  compliance  percentage  can  be  entered 
instead  of  the  actual/possible  figures  if  each  of  the  providers  has  an  equal  number 
of  records  audited.  The  probability  of  having  equal  possible  values  for  each 
provider  is  minimal.  Therefore,  to  avoid  distorting  the  cumulative  percentage,  the 
actual  and  possible  values  are  totaled  and  the  percentage  value  is  determined  from 
the  resultant  totals. 

The  blocks  in  the  bottom  right  hand  portion  of  the  matrix  are  provided  to 
record  the  overall  values  of  the  audit  results.  The  actual  and  possible  values  in 
those  blocks  are  the  same  if  the  horizontal  or  vertical  marginal  values  are  added. 
A  check  of  the  correctness  of  the  matrix  can  be  done  by  adding  the  horizontal  and 
vertical  marginal  values  to  insure  the  totals  are  the  same.  The  calculation  of  the 
overall  compliance  rate  is  computed  based  on  the  cumulative  marginal  values  of 
the  actual  and  possible  outcomes.  The  reason  for  computing  the  overall 
compliance  rate  on  the  total  value  of  the  actual/possible  values  is  the  same  as 
mentioned  previously  in  determining  the  marginal  percentages,  i.e.,  different 
values  of  the  denominator. 

The  summary  audit  matrix  provides  the  auditors  a  concise  array  of  data  by 
which  a  number  of  statistical  tests  can  be  performed.  In  addition  to  statistical 
testing,  the  data  can  also  be  used  to  calculate  descriptive  statistics.  The  matrices 
are  not  a  panacea  for  all  data  collection  situations  but  are  versatile  and  provide 
assistance  in  data  collection  for  quality  assurance  studies. 

Data  Manipulation 

Subsequent  to  data  collection,  the  individual  performing  the  QA  study  must 
analyze  the  results.  There  is  not  a  standard  analysis,  the  nature  of  the  problem 


dictates  the  type  of  analysis.  Statistical  tests  enable  the  individual  conducting  the 
study  to  analyze  the  data  utilizing  accepted  techniques.  The  results  of  the 
statistical  tests  are  extremely  valuable  in  reaching  a  solid/defendable  conclusion. 

To  determine  the  appropriate  analysis,  the  study  supervisior  must  decide  on 
what  the  study  is  to  determine.  Common  statistical  techniques  are: 

1.  Descriptive  Statistics  -  provides  a  mathematical  portrait  of  study  data, 
paticularly  useful  in  an  initial  study.  The  results  provide  a  basis  for  follow-up 
studies.  A  more  complete  discussion  is  contained  in  Appendix  K. 

2.  Hypothesis  Testing  -  enables  the  study  supervisor  to  draw  statistical 
conclusions  on  observed  data  based  on  predetermined  standards.  This  technique 
can  be  widely  used  by  the  practitioner  in  evaluating  treatment  effectiveness, 
practitioner  compliance  with  audit  criteria,  and  any  other  observable  event  for 
which  an  accceptablity  standard  is  determined.  The  standard  on  which  a  hypothesis 
test  is  based  may  be  established  by  medical  literature,  regulation  or  local  standard. 
Further  discussion  on  hypothesis  testing  with  a  large  sample  is  contained  in 
Appendix  L. 

3.  T-test  -  provides  the  same  information  as  discussed  in  the  preceding 
paragraph  with  the  exception  that  the  sample  size  is  generally  less  than  thirty. 

4.  Analysis  of  Variance  -  allows  the  individual  conducting  the  study  to 
determine  if  there  is  a  difference  between  two  samples  by  comparing  variations  in 
sample  data.  This  technique  is  extremely  useful  in  determining  effectiveness  of 
follow-up  actions  by  reauditing  a  problem  using  the  original  criteria  and  comparing 
results.  This  test  reveals  whether  a  statistically  significant  difference  exists.  A 
more  complete  discussion  is  at  Appendix  M. 


5.  Chi-squared  Test  -  this  test  calculates  the  probability  that  observed 
outcomes  of  various  events  are  significantly  different  than  the  expected  outcomes. 
This  test  is  very  easy  to  use  and  an  example  of  the  test  results  is  at  Appendix  N. 

6.  Regression  Analysis  -  calculates  the  correlation  between  a  dependent 
variable  and  one  or  more  independent  variables.  This  technique  is  useful  in 
analyzing  the  impact  of  the  interaction  of  the  variables  in  the  patient  encounter. 
Appendix  O  contains  the  results  of  regression  analysis  involving  patient  satisfaction 
and  clinic  workload.^ 

Conclusion  Development  Based  on  Data  Analysis 

Utilizing  the  data  analysis,  the  QA  study  supervisor  is  in  a  position  to  develop 
conclusions  regarding  the  study.  He/she  must  use  the  statistical  results  and  his/her 
professional  knowledge  in  order  to  accomplish  this. 

Possible  conclusions  include: 
no  problem  exists, 

problem  requires  practitioner  training, 

problem  requires  changes  in  method  of  operation,  physical  plant 
alteration,  or  administative  action, 

-  problem  requires  restriction  of  practitioner  privileges, 
problem  requires  extension  of  study  to  other  activities. 

The  conclusion  should  be  speciiic  and  obtainable.  If  the  conclusion  requires  actions 
outside  the  authority  of  the  department/committee,  the  responsible  official  must 
be  notified.  A  recommendation  regarding  follow-up  action  must  be  made. 


Follow-up  Action 


In  order  to  demonstrate  effectiveness,  the  QA  process  is  not  complete  until 
follow-up  action  is  performed.  The  follow-up  should  be  planned  so  that  corrective 
actions  have  time  to  take  effect,  and  the  follow-up  should  duplicate  the 
circumstances  of  the  initial  study.  Altering  the  cirumstances  would  invalidate  the 
follow-up  results.  By  utilizing  the  QA  study  format  outlined  in  Appendix  P  and  the 
appropriate  statistical  tests,  the  study  follow-up  should  not  be  difficult  to  conduct. 
The  follow-up  step  is  not  only  necessary  to  fulfill  the  JCAH  standards  but  also 
demonstrates  to  the  staff  the  effectiveness  of  the  program. 
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Footnotes 


1  Joint  Commission  on  Accreditation  of  Hospitals,  Manual  for  Accreditation, 
Chicago, IL,  1981,  pp.  152-154. 

^Record  of  Quality  Assurance  Studies,  Office  of  the  Chief,  Professional 
Services,  DeWitt  Army  Community  Hospital,  Fort  Belvoir,  Virginia  as  of  30  April 
1982. 


^US  Department  of  the  Army,  Army  Regulation  40-66,  Medical  Records  and 
Quality  Assurance  Administration,  15  July  1980,  Chapter  9. 

^InterQual  pp.  35-36. 

^Interview  with  Major  Robert  Ridenour,  Assistant  Chief,  Department  of 
Pathology,  DeWitt  Army  Community  Hospital,  Fort  Belvoir,  Virginia  on  16  April 
1982. 


^Interview  with  Colonel  Jose  Ossorio,  Chief,  Professional  Services,  DeWitt 
Army  Community  Hospital,  Fort  Belvoir,  Virginia  on  10  March  1982. 

^Interview  with  Major  Thomas  Hoffer,  Chief,  Emergency  Medical  Service, 
DeWitt  Army  Community  Hospital,  Fort  Belvoir,  VA  22060,  on  14  March  1982. 

^Interview  with  Major  Rideuour. 

9JCAH,  p.  152. 

^Interview  with  LTC  Thomas  Puskas,  Chief,  Outlying  Clinics,  Department  of 
Family  Practice,  DeWitt  Army  Community  Hospital,  Fort  Belvoir,  Virginia,  on  13 
April  1982. 

^Telephone  Interview  with  Lieutenant  Colonel  Arthur  Badgett,  Chief, 
Biostatistical/Division,  Patient  Administration  System  and  Biostatistical  Agency, 
US  Army  Health  Services  Command,  Fort  Sam  Houston,  Texas,  on  13  April  1982. 

^interview  with  Captain  Michael  Coleman,  Chief,  Outpatient  Records, 
Patient  Administration  Division,  DeWitt  Army  Community  Hospital,  Fort  Belvoir, 
Virginia,  on  28  April  1982. 

^U-S.  Department  of  the  Army,  Army  Regulation  340-18-9,  Maintenance  and 
Disposition  of  Medical  Functional  Files,  1  December  1979  p.  27. 

^Presentation  by  Colonel  Kenneth  Lingel,  Deputy  Chief  of  Staff  for 
Resource  Management,  Headquarters  US  Army  Health  Services  Command,  Fort 
Sam  Houston  at  the  Ambulatory  Patient  Care  Conference,  Fort  Sam  Houston,  TX 
on  1  April  1982. 

^R.C.,  Gulezian,  Statistics  for  Decision  Making,  (Philadelphia,  1979)  pp.  21- 
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CHAPTER  V 


CONCLUSION 


The  ambulatory  quality  assurance  program  at  DeWitt  Army  Community 
Hospital  can  be  improved.  The  current  difficulties  with  the  program  result  from  a 
lack  of  focus  on  the  JCAH  QA  standards  which  are  a  responsibility  of  the  reporting 
activities.  The  departments,  activities  and  committees  which  report  on  quality 
assurance  must  concentrate  ons 
-Being  problem  focused, 

-Having  clinically  valid  criteria, 

-Having  documentation,  and 
-Having  follow-up  actions. 

If  these  four  requirements  are  adhered  to  by  the  reporting  organizations,  the 
program  will  be  effective. 

The  leadership  of  the  hospital  must  convey  to  the  department,  activity  and 
committee  chairpersons  of  the  organization  the  importance  of  their  contribution  in 
the  QA  process.  By  fulfilling  the  four  QA  principles  for  which  they  have  direct 
responsibility,  these  leaders  will  drive  the  program. 

The  importance  of  quality  assurance  commands  the  fullest  support  of  the 
entire  hospital  staff.  The  potential  benefits  of  an  active  quality  assurance  program 
justifies  the  expenditure  of  effort  necessary  to  achieve  it. 
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Memorandum 

No.  40-91  22  December  1980 

Medical  Services 
QUALITY  ASSURANCE  PLAN 


1,  Purpose.  The  purpose  of  this  memorandum  is  to  establish  a  written  plan  that 
will  serve  as  a  basis  for  a  comprehensive,  fully  integrated,  problem-focused 
approach  to  a  Quality  Assurance  Plan  for  US  DeWitt  Army  Hospital  (USDAH). 

2.  General.  The  overall  goal  of  the  Quality  Assurance  Program  (QAP)  is  to 
demonstrate  USDAH 1 5  comprehensive  and  integrated  approach  to  quality  assurance. 
The  principal  objective  of  the  QAP  is  to  facilitate  the  ongoing  identification 
and  assessment  of  problems  associated  with  clinical  performance  and  the  delivery 
of  patient  care/clinical  performance  with  the  intent  of  improving  such  care  to 
an  optimal  level  within  available  resource  constraints.  The  Executive  Cornmlf tee 
■dial!  serve  also  as  the  Quality  Assurance  Committee  jor.jJSU^H'.' 

3,  Scope.  Quality  Assurance  (QA)  refers  to  all  organisational  activities  that 
are  designed  to  foster  or  evaluate  patient  care.  It  includes  all  departments, 
disciplines,  nractioners ,  ancillary  personnel,  committees,  and  administrative 
personnel.  The  Commander,  US  DeWitt  Arrqy  Hospital  is  recognized  as  the  delegated 
and  ultimate  authority  to  Represent  the  governing  body  (Office  of  the  Surgeon 
General)  at  the  local  level.  Health  care  providers  will  participate  in  peer- 
review  and  all  patient  care  processes  will  be  subject  potentially  to  evaluation. 

4.  Definitions  and  Goals.  Evaluation  of  actual  performance  will  be  measured 
against  clinically  valid  criteria.  Clinically  valid  criteria  is  defined  as 
standards,  objectives,  or  criteria  that  are  based  on  a  review  of  professional 
standards  as  reflected  in  current  clinical  literature.  The  criteria  "should  be 
expected  to  result  in  improved  patient  care/clinical  performance,"  (JCAH  1981 
Manual,  p.  152)  Criteria  developed  within  the  hospital  or  in  conjunction  with 
other  area  hospitals  may  also  be  used  as  appropriate.  Structure,  outcome,  or 
process  assessments  may  be  used  concurrently ,  retrospect! vely  or  prospecti vely. 
Formal  or  informal  means  (or  studies)  may  be  used  in  investigating  the  known 

or  suspected  problem  area(s).  In  all  cases  written  documentation  will  be 
maintained  as  evidence  of  all  of  the  QA  studies  and/or  investigations.  Credit 
shall  be  given  for  QA  investigations  or  studies  which  result  in  the  finding 
that  no  significant  problem  existed  and  that  therefore  no  corrective  action 
is  required.  Both  informal  efforts  and  formal  studies,  as  appropriate  to  the 
situation,  can  be  used  in  the  QAP  provided  the  studies  and  efforts  are 
documented  in  writing.  It  shall  be  the  goal  of  DeWitt  Army  Hospital  to  use 
o.pprcpriately  both  the  formal  and  informal  approach  in  the  QAP,  Documentation 
of  the  QA  efforts/studles  shall  be  reflected  in  all  committee  minutes  effective 
1  January  I'i81.  Follow  up  and  monitoring  activities  also  shall  be  reflected 
in  the  minutes  to  determine  the  extent  of  Improved  patient  care  and/or  the 
need  for  additional  monitoring  or  QA  studies.  There  shall  be  no  specific 
number  of  studies  required.  However,  committees  have  the  responsibi 1 i ty  to 

*rhls  Memorandum  supersedes  MEDDAC  Memorandum  40-401  dated  10  October  198G. 
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conduct  QA  atr  "e?  that  are  problem-focused  on  an  ongoing  basis. 

Each  cl:n»cal  d'so’p  1  me  (.professional  staff)  will  review  the  patv-t  ■ 
it  provides.  Reso its/ findings  of  each  department  on  0A  matters  will  be 
communicated  vn  a  w-'tren  report  to  the  Chief,  Professional  Service;  (CFS)  : 
a  quarter’y  bas's  or  more  frequently  as  directed  by  the  CPS 

Each  administrative  department  will  review  its  operation  to  determine 
tf  an/  QA  stud'es  are  deemed  appropriate.  Departmental  or  mterdepartmenta I 
QA  studies  will  be  initiated  and  reported  by  the  administrative  departments 
on  an  Ad  Hoc  ba;-*!s  at  the  discretion  of  the  administrative  department  nead. 

An  annual  summary  cf  a'*:  QA  studies  ac>.  ;-mp1  (shed  or  underway  will  be  forward 
to  the  Executive  Officer  pr'or  to  December  of  each  year  by  the  aammistrat1 
department  heads. 

Department  chiefs  and  committees  will  cooperate  in  conducting  interder  nntal 
or  other  QA  studies  as  directed  by  the  Executive  Committee.'  In  addition,  w  PS 

(for  cl  in -caV  studies)  or  the  Executive  Officer  (for  administrative  studi-r'  j 

task  deoartment  chiefs  or  committee  chairmen  to  conduct  QA  studies.  In  .  ; 
a  record  shall  be  maintained  by  the  Executive  Committee  of  all  proposed,  cc.  •  „:ad, 
and  rejected  QA  studies.  The  findings  (or  reasons  for  rejection  of  the  5*rv 
shall  be  documented  as  a  matter  of  record  for  review  by  the  JCAH  or  othe’1 
authorized  inspecting  body.  Follow  up  monitoring  to  document  improverne*'  .lent 

care/cl intcaV  performance  shall  also be  directed  by  the  Executive  Commicr.s<? 
order  to  insure  that  modi fTcationa- needed  to  enhance. the  quality  of  care  hcvu  been 
accomplished-,  4 '  w  > "  "  ' 

huspitai  •Continuing  Health  Education  (CHE)  Programs  will  respond  to 
info-mat 'on  ?o  as  to  address  areas  where  knowledge  deficiencies  are  noted  by  my 
QA  stud  es  ,  Documentation  of  such  CHE  Programs  shall  be  forwarded  to  tbs  C.T> 
by  department  c.h0  ‘ 'men- who  'nitiate  the  needed  session  or  CHE  Programs.  This 
documentation  m-a*  be  a  pa'-t  of  the  quarterly  written  reports  to  the  CPS, 

to  the  me* 'mum  estent  possible  QA  activities  shall  minimize  duplication 
effort.  Cons'deraf'on  should  oe  taken  of  the  potential  benefit  cf  a  propos.^-J 
study  when  compared  to  rre  cett- (time  or  other  resources)  of  conducting  Jv- 
study. 

5.  Responsib1' • 't  'es. 

a,  The  Commander ,  uSDAH  is  recognized  as  the  delegated  and  ultimate  authority 
to  represent  the  go'e-n^ng  oody  (0rSG)  at  the  local  levei .  As  such,  he  holds 
the  ultimate  responsi'fai lity  for  Quality  Assurance  Activities  within  the  MECCAC. 

Thus,  ne  shall  make  all  final  determinations  of  the  extent,  if  any,  to  whicn 
outside  a<ds  (consultants  cr  vo'untary  rev-ew  bodies,  for  example)  snail  be  used 

in  QA  activities  to  (dent  fy  and/or  assess  problems. 

\ 

i  the  Chief Profess lorraH  Services  (CPS)  is  responsible  ta'  the  commander 
for  tne  conduct  and  'mp lamentation  of  the  QA  Program  and  for  compliance  with 
the  JCAH  QA  standards  and  the  HSC-  di recti ves-  on  QA  matters,  The  CPS  is  responsible 
fer  tne  coordination  of  aM  QA  activities. 
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c  Tfta  executes  Officer  (.* 0 )  is  responsible  to  the  cogence'-  v  insure  chat 
- h v  f-P  '  s  c o s t  effect •' vs . 

a.  An  department  enters  ana  committee  chairmen  are  res;.ons’ :•*■.-  to  the  CPS 
for  the  »mplererf at'on  and  conduct  of  an  effective  QAP  wi:h*n  tnev-  respective 
departments  and.  ’ ccrnml trees . 

(1)  Interdepartmental  QA  studies  (proposed).  Appendix  A  :oao': 'ies  the 
format  to  be  used  in  submitting  a  proposal  for  an  interdepartmental  study.  A 
department  ch-'ef  or  a  committee  chairman  may  initiate  a  proposal  for  a  QA  study 

by  using  the  format  shown  at  Appendix  A,  In  addition,  any  other  personnel  assigned 
to  USDAH  may  initiate  a  proposal  for  a  QA  study  by  completing  the  QA  Study  Proposal 
(OF)  and  by  submitting ’it  through  departmental  or  committee  channels.  These  will 
be  forwarded  to  the  HEC,  XO  or  CPS.  If  disapproved  for  study,  the  reason(s)  will 
be  documented  for  review  by  the  JCAH  or  other  authorized  inspecting  body. 

(2)  Reports  on  QA  Studies  Conducted.  Appendix  S  specifies  the  format  to 
be  used  in  reporting  on  Quality  Assurance  Studies.  This  format  w 1 1  be  used  for 
studies  done  within  a  department  and  for  interdepartmental  studies.  Committees  may 
elect  tc  briefly  summarize  a  problem,  solution  ana  follow  up  act<on  in  the  cwrmltcee 
minutes  If  resolut'on  of  the  problem  can  be  determined  easily  (see  paragraph  7a(l)). 
Committees  are  encouraged  to  use  the  format  at  Appendix  3  when  feasible  and  appropriate. 
The  Executive  Committee  shall  determine  which  problem  focused  forma?  and/or  in¬ 
formal  studies  should  os  initiated.  In  addition,  the  CPS  may  direct  QA  studies  In 

the  administrative  areas  Department  chairmen  may  direct  QA  studies  within  their 
departments  or.#n  caoperatlcg, w-Ttn  another  department^ ). 

6.  Admin ist'ation/Coordinafion  of  the  QAP.  The  Hospital  Executive  Committee  shall 
Insure-  that  the  QAP  Is  implemented  In  an  ongoing  manner  as  required  by  JCAH.  The 
Hospital  Executive  Committee  shall  also  Insure  that  the  QAP  is  reappraised  at 
least  annua. ly.  The  'eappraisai  snail  result  in  the  identification  of  "components 
of  the  Quality  Assurance  Program  that  need  to  be  instituted,  (shall)  assure  that 
the  program  v*  ongoing,  comprehensive,  effective  in  improving  patfent  care/ 
ciin^ca'  performance,  and’ conducted  with  cost  efficiency."  IJCAH  1981  Standard, 

pp  5  3 -4  f 

The  QA  Committee  snail  consist  of  the  membership  shown  at  Appendix  C.  The 
fow  of  QA  *nfo-*mation  for  committees  and  departments  is  shown  at  Appendix  D. 

Relevant  feedoacx  fn*r  •naripn  should  be  channeled  from  the  Executive  Committee  to 
department  cmerv  ana  o”  to  cha-' ''men  of  committees  so  that  the  QAP  is  comprehensive. 
Integrated,  and  continuous . 

7.  Implementation. 

a.  Methodology  The  QAP  *ii1  pe  committee/department  oriented.  Each  committee/ 
department  wl ’  l  ■'n'r'a1,y  be  ‘•equired  to  review  the  QA  standard,  1981  JCAH 
Accreditation  Manual  for  hqsq ital s ,  and  this  MEODAC  Memorandum. 

(1)  Committee  minutes/ report  format  will  make  a  statement  by  separate 
paragraph  (entitled  QUAHTV  ASSURANCE)  to  the  effect  that  a  QA  problem  was/was  not 
identified  by  that  ;cmm<t-'ee .  When  a  QA  problem  is  identified,  a  brief  summary  of 
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the  problem  and  proposed  solution  or  method  of  investigation  will  be  included 
for  subsequent  revew  by  ’.he  Kqsp., U*1  Executive  Committee.  This  paragraph  will 
also  snow  docmr,er«tat'dn/evicfenca  of  fo.Tfov  cp-T^ct-idii  reference  previous  nnblems . 

(2)  AH  committee  reportrs  ^7**^S»rS'u£artttt2d  to  the  Hospital  Executive 
Committee  for  review,  evaluation  and  coordination  of  QA  matters.  The  Chief, 
Professional  Services  in  coord-nation  with  the  Executive  Officer  wilt  establish 
and  periodically  update  priorities  with  regard  to  the  order  in  which  inter¬ 
departmental  problems  should  be  assessed.  The  Executive  Committee  will  direct 
comprehensive  studies  of  problems -to -affected  committees*  activities,  depart¬ 
ments,  and  divisions  and  will  ossfgrt  rfcsf«fc&»^i44-£y.  fw-jyxaiea. .investigation 
and  resolution.  The  format  show  at  Appendix  ^  (Proposed  QA  Study)  may  be 
used  for  this  purpose  or  the  lUecuMye  Co%ri tiee  swjr  giye  general  guidance  on 
the  known  or  suspected  problem  and  may  direct  those  assigned  to  prepare  a  report 
(Appendix  B)  based  on  their  investigation  and  .findings. 

(3)  The  Executive  Committee  will  direct  appropriate  follow  up  action 
through  its  committee  review  process-  The  Hospital  Executive  Committee  will 
monitor  problem  resolutions  at  . least  once  during  the  snbseouent  auartar  and 
durtng  the  annual  review 

(4)  The  Hospital  Executive  Committee  will  review  and  evaluate  the 
QAP  annually  during  December  beginning  in  December  1981.  During  the  annual 
review,  this  QA.  Memorandum  will  be  updated  and/or  revised.  Documentation  of 
"annua V •  reassessment  w'V  consist  . of -a  list  of  problems  identified  during,.. 

•  cfle  past  year  and  a  summary  statement  as  to  the  program's  impact  on  improving;; 
cHntcal  pe-formante  v:3  pef'ent  care.  The  above  documentatioa  will  beTnade.'-5 
a  part  of  the  mlr.utes  of  the  Oecember  Hospital  Executive  Committee  meeting. -  * 

The  Hospital  Exe*.*;tive  Officer  and  Chief,  Professional  Services  will  develop  ’ 
the  p-^blem  list  o  odvan<e  of  the  QAP  annual  review. 

B,  ProDlem  Idem  tr'fcat'on  There  are  to- specific  numerical  requirements 
with  regard  tc  QA. problem'-  Dc-W\tt  Army  Hospital  should  Identify  annually.  The 
annual  go*’*  of  DeW’tf.  Arm>  Hospital  will  be  to  identify  and  resolve  a  minimum 
of  one  QA  pnooiem  pe^  hc.'pf*-a‘  conroittee,  with  the  exception  of  the  Medical 
Library  Committee,  tne  Ace  red' tat 'on  Committee,  and  the  Health  Consumer 
Committee.  The  attached  list  of  data  sources  (Appendix  E)  will  assist  in 
problem  identification .  C'*n»ca*:ly  valid  criteria  will  be  used  to  :dentify 
and  assess  problems.  thc  qa?  will  focus  primarily  on: 

Kcowr.  suspected  problems  (not  limited  to  diagnoses  or  procedures). 

(2)  Problems  for  which  there  are  local  solutions. 

(3 i  Problems  that  adversely  impact  on  patient  care  or  benefits. 

c.  Pno'em  eocused  Approach.  The  problem  focused  approach  is  to  Be 
utilized  for  all  QA  stud'es  A  problem  is  defined  as  any  deviation  from  an 
expected  desirable  outcome  or  an  area  of  concern.  The  problem  focused  approach 
Ts  Based  on  the  assumption  that  to  obtain  maximal  benefit  from  a  QA  study 
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emphas's  it.u:C  be  focused  on  the  resolution  of  known  or  suspected  problems.  In 
addition,  due  to  resource  l'm'tat’ons,  priorities  must  bo  established  so  that 
those  problems  hav<ng  t re  mc-t  immediate  and  adverse  impact  on  patient  care 
will  be  studied*/ ■ 


C  t  J  Problem  laeotiiKat'un .  Proolein  identi  ficacion  should  oe  encouraged 
at  all  levels  within  the  health  care  organization.  Departmental  and  service 
chiefs  will  formulate  and  'mpiement  a  mechanism  for  encouraging  problem 
identification  and  Submit,  problem  lists  with  priority  rationale  to  the 
Executive  Committee  for  further  prioritization.  Problem  identification  is  to 
be  concurrent  and  ongoing. 


(2'l  Problem  p-'O'itizafon.  A  problem  list  will  be  formulated  and 
maintained  in  order  to  insure  that  the  hospital  QAP  encompasses  all  organizational 
elements  and  that  •‘esources  a-e  ut' Sized  for  maximum  benefit.  The  CPS,  Director 
of  Nursing,  and  X0  will  compile  the  problem  lists  and  recommend  study  priorities. 
The  Executive  Committee  will  review  the  current  list  at  each  monthly  meeting  and 
will  make  changes  as  needed.  O-'d'narily  the  establishment  of  priorities  for 
problem  resolution  shjll  be  v21rted  to  the  degree  of  adverse  impact  on  patient 
care  that  can  be  expected  if  the  problem  remains  unresolved. 


8.  Other  Quality  Assurance  Responsibilities.  The  Executive  Committee  will  insure 
that  the  staff  and  al'  commHtees  comply  with  OCAH  evaluations  required  at  the 
prescribed  rrequenc/e*  .zee  Append*  <  F). 


9.  Reporting  Procedo'e:;'  TKfFre"-.s  "0  spec;fic  number  of  QA  studies  which  must 
be  completed  -n  order  *o  uomp.y  *»th  existing  requirements.  The  HEC  will  monitor 
the  entire  QAP.  to  'nsu'e  that  a"  organizational  elements  are  involved.  QA 
studies  shou'a  u-*e  the  sn^wr  at  Append’*  A  and  Appendix  B.  Reports  will 

be  submitted  aV.g  tf-e  o- ga<*  zat  ona'  <-nes  identified  *n  the  Quality  Assurance 
Information  Fio*  Cha-r  .'.Appendix  D  Alternate  informal  reporting  pathways 
may  be  utv,,'zed  wn»?nfc.ee  -.pp  ..p-'die  fu  facilitate  the  maximum  exchange  of  in¬ 
formation  •  Ail  QA  cxud-'**.  w  •  c*  : reuted  as  sensitive,  confidential  information 
to  be  made  a-a'oce  to  iu ire  ied  ra-vduals  with  a  legitimate  "need  to  know". 
The  CPS  wi‘l  coo'a'r.jte  a'  •  QA  -eporfng  activities.  The  HEC  will  serve  as  cus¬ 
todian  of  all  QA  't-co  i'.  and  uiiient? 


10  P'-ob'.em  rte*o-u»-'o  hi-70  ut  on  of  p'oolems  may  require  any  or  all  of  the 


following; 

a  - 

New/ 'b  *  •'  ved  bQP  -i 

b. 

Staffing  changes 

c. 

Equipment.-  tai  <i  *ty  v.hongee 

4. 

Sanctions  :  >.  •  ■  n  •  m ' 

e. 

Education  and/or  tro’n-ng 

Continuing  Medfca'  Education  i.CME;  and, or  training  programs  will  be  used  as 
appropriate  as  a  veh’c  e  for  resolving  problems  noted  in  0A  studies  or  other 
QA  activities  Documentat'on  of  CtoE  ^levant  to  QA  matters  will  be  accomplished 
through  committee  m'nutes  and, or  departmental  channels  as  appropriate. 
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MEDDAC  Memo  40-91 


22  December  1980 


11.  Self  Assessment  of  QA.  (See  Self  Assessment  Matrix  (as  of  Sep  1?80)  - 
Appendix  G.) 


a.  The  Executive  Committee  will  Insure  that  QA  information  (input  and 
feedback)  Is  shared  In  an  appropriate  manner  with  other  ccrrmictaes  and/or 
departments  In  order  to  facilitate  communication  on  QA  matters  that  may  result 
in  improvements  to  care  and/or  the  operation  of  DeWitt  Army  Community  Hospital . 


b.  The  Executive  Committee  will  review  the  Self  Assessment  Matrix  at 
least  quarterly  to  determine  which  committees  may  be  combined  or  made  sub¬ 
committees  of  another  committee  in  oroer  to  avoid  or  reduce  duplication  of 
efforts  by  those  committees. 


c.  Additionally,  the  Executive  Committee  will  review  the  Self  Assessment 
Matrix  at  least  quarterly  to  insure  that  the  flow  of  information  and  other 
aspects  of  the  Matrix  meet  the  spirit  and  Intent  of  current  JCAH  requirements. 
Recommended  changes  should  be  communicated  to  the  committee (s)  involved. 


12.  References  and  Aurncrity.  - 

a.  AR  40-66,  Chapter  9,  "Quality  Assurance" 

b.  JCAH  Accreditation-Manual-  for  Hospitals ,  1981 


^  c.  MEDDAC  Memo  15— i ,  MEDDAC.. Committees,  Boards,  Councils,  and  Conferences, 
•  9  October  1980  ';; 


d.  MEDDAC  Policy  No-.  40-401 ,  Quality  Assurance  Plan,  22  Apr  30  (Ft  Meade 
MEDDAC) 


e.  Ltr,  Subj  Implement at ion  of  the  New  JCAH  Standards  on  Quality  Assurance, 
22  Feb  80  (HS0P-PR); 


AHDCM-AR 

FOR  THE  COMMANDER: 


MARGA8ET  A.  MAGGIO  // 

1LT,  MSC 

Adjutant 


D:STR!3UT!0N: 
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SPOSmON  FORM 

m  thl,  loem,  «m  AN  344-I9;  tl*s 
y  [l  Th«  Adturtnt  0#nvil  C»nt»f. _ 


NCc  Oft  OFFICE  SYMSOv 


Proposed  Quality  Assurance  Study  (Subject  of  Study) 


.<0  or  Executive  Committee 
Problem:  (.State  briefly) 

How  Identified:  (Department,  committee,  complaints,  etc,) 

Objecttve(s)  of  Study: 

Criteria:  (Examples:  JCAH  Standards,  SQP's,  AR'S,  Local  staff  consensus  or 
lion,  audit,  etc.) 

Resources  Required: 

a.  Personnel  (List  recommendations  of  personnel  to  conduct  study) 

b.  Time  (Estimate  the  ttme  needed  to  conduct  study  and  report  findings) 

c.  Equipmenl/Supplies  (Estimate  cost*,  if  applicable) 

d.  Other  (List  other  departments  involved  and  list  other  pertinent  resource  costs  not 
.viously  identified) 

Recommended  Priortty:  (Within  department/hospttal  or  other,  Discuss  impact  if 
:blem  is  not  studied) 

Other  Comments:  (If  any) 


Chief,  department  or  Committee 


FROM  CPS'  DATE 

XO  or  Executive  Committee 


CMT  2 


Study  is  approved/disapproved/deferred  at  this  time.  NOTE:  IF  APPROVED,  THE  PRIORITY 
SIGNED  WILL  BE  NOTED,  NOTE:  IF  STUDY  IS  DISAPPROVED  OR~DEFERRED  THE  REASON  KILL  BE 
ATED. 


Chairman  for  study  is 


3.  Departments  involved  in  study:  (Specify) 


.  Others  on  committee  are 


a.  Constraints:  (Optional  paragraph.  Example:  Constraints  on  resources) 
5.  Suspense  date  for  completion  of  study  Is:  (Specify) 


(APPENDIX  A 


CPS  or  XO 


FOhM 

i  plan 


DISPOSITION  FORM 


P*9f  UM  o4  thU  form,  in  AA  34Q.1S;  th«  oroponemt 
iwkv  liTho  Adlytgni  Ojggtj Corny. 


.SEPe BENCE  OB  OFFICE  SYM80L 


|  SUBJECT 

Report  on  QA  Study  (Subject  of  Study) 


to  CPS 

XO  or  Executive  Committee 


1.  Problem: 


2.  How  Identified: 


3.  Objective(s)  of  Study: 


4.  Criteria: 


5.  Resources  Required: 


NOTE:  The  first  6  paragraphs  may  be  omitted  if 
previously  documented  in  a  QA  proposal.  (See 
Appendix  A)  However,  for  studies  done  within  a 
department,  and  reported  upon  completion,  all  of 
the  paragraphs  will  be  shown. 


6.  Priority: 


7.  Actions  Taken:  (Examples:  Samples,  audits,  design  of  study,  etc.) 


8.  Results:  '(What  you  found) 


9.  Corrective  Action(s):  (List  actions  taken,  if  applicable) 


10.  Recommended  follow  up  actions  to  determine  effectiveness: 

f.  ‘ 

a.  Short  range: 

fr.  Long  range:  (Indicate  time  frames  and/or  frequencies  of  monitoring.  Specify 
how  follow  up  fs  to  be  accomplished,) 


MOTE:  Other  paragraphs,  if  appropriate,  may  be  added  to  those  shown  above. 


Chairman  of  Study 


TO  FROM  CPS/XO/HEC 

1.  Identify  plan  for  review  and  further' action  or  follow  up. 

2.  Establish  suspense  date  if  appropriate. 


CMT  2 
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TO  CPS/XO/HEC  FROM  C^TE  CMT 

1.  Provide  details  of  follow  up  and/or  monitor’ng.  State  if  further  monitoring 
hould  &e  continued  and  give  recommendations  (type  cf  follow  up,  timing,  frequency, 
tc.  j. 

2.  Other  comments  are  optional. 


Chairman  of  Study 


1.  Prescribe  plan  for  continuation  of  follow  up  or  further  investigation. 

2.  Note  that  problem  has  been  resolved  (or  that  no  problem  was  found  to  exist  upon 
Investigation) . 


c“ps7x0/“he 


QA  COMMITTEE  MEMBERS 


Commander,  US  DeWitt  Army  Hospital 

Executive  Officer 

Chief,  Professional  Services 

Chief,  Department  of  Nursing 

Administrative  Resident  (non  voting  member) 

Secretary,  MEDDAC  Commander,  Recorder  (non  voting) 


c 

NOTE:  THE  ABOVE  MEMBERS  ARE  ALSO  MEMBERS  OF  THE  EXECUTIVE  COMMITTEE 


APPENDIX  C 


Ft.C;{  cf  :ri,-o:^Anc.M  of  o  :mmi;t:es 
(Effective  1  January  1031) 

Hospital  Executive  Ccumitta® 


^  '  1 

> 

-p 

/•* 

t — *  jri  lizaticn  Review  <•  —  -  • 

jf- - V 

,1/ 

■ 

>—  — 

—  -?>  rP'i  <— 

- -v  xo 

•>< — * Crouentials  Coroil  ttee  t*  -  *. 

r  t 

'T  *  r 

V  > 

*»*?■ 

i 

All  Clinical 

a  *  t 

.-ill 

l 

Departments 

Administrative 

1 

i 

( 

I 

'T* 
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Patient  Care  Auditing  (MCE  Committee)  I — Accreditati 
■jAB  1 — Autumacio.i 


r;C 


—  Infection  Control 

— — Nursing  Audit 

——Ambulatory  Care  Committee ..  - 

-—Blood  Transfusion  and  Tissue/ 
Statistical  Review 

— -  Cancer  Committee 

-r-  Clinical  Investigation  Subcommittee 

— -  Tumor  Board 


—  Autumacio.i  Guidance  Council 

- Civilian  Training  Committee 

- Cnme  Prevention  Council 

- Disaster  Planning  Committee 

-  Energy  Conservation  Council 

- Health  Consumer  Committee 

-  Jo’nt  Staff  Conference 

-  Labor  Management  Committee 

-  L'nen  Management 

- Medical  Library 

—  Planning  Committee 

-  Professional  Education  Committee 

—  Program  &  Budget  Advisory  Committee 
— -  Safety  and  Fire  Prevention 
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QA  DATA  SOURCES 


Medical  Records 

Pharmacy  Prescriptions 

Patient  or  Practitioner  Profile  Data 

Nursing  Audits 

Risk  Management  Reports  or  Studies 
Financial  Data  - 
Letters  of  Complaint/Coirment 
Medical  Statistics  ' 

Blood  Utilization  Review 
Infection  Control  Findings 
Radiology  Reports 
Utilization  Review  Studies 
IG  Reports 
AAA  Reports  . 

Mortality /Morbidity  Review 
Profile  Analysis 


Committee  Findings 

Current  Literature 

Medical  Audits 

Incident  Reports 

Ancillary  Services  Requests  and 
Reports 

Patient  Surveys  or  Comments 

Personnel  Staff  Interviews 

Tissue  Review 

Safety  Findings 

Liberate -y  Reports 

Other  Diagnostic/Clinical  Reports 

Internal  Review  Studies 

JCAH  Survey  Recommendations 

Observations 

Review  of  Treatment 


APPENDIX  E 


HOSPITAL  WIDE  FUNCTION'S  REQUIRING  MEDICAL  STAFF  PARTI' 


ACTIVITY 

FUNCTION 

:  .... ENCY 

liVsCUQP  Centre!  Corrirmif** 
(Infection  Control  SUmJauJ 

Review  infection*  wnthm  the  hoipnal,  cultures  of  p*’fvonnnl  or 
th»i  environrr.um,  result*  any  .intimicrcbial  *usc*2ptih>iirv/ 

•  revetanctl  trend  studies,  propolis  and  protocol  for  all  specul 
inf-ction  control  studi-f*  conducted  throuijh^ut  Hospital 

:  (■  tn 

.  i  r.nths 

Mulud'sctplmary  Safety 

Committee 

(Functional  Safety  and  Sanitation 
Standard  1) 

Adapt,  implement,  and  monitor  a  comprehensive,  hospital  wide  '  '  I ; 

safety  program  j 

1 

1 

l 

1  - 

Ditaattr  Planning  (mechanism 
not  specified) 

(Functional  Safety  and 

Sanitation  Standard  III) 

PUn  for  external  and  internal  disasters,  and  rehearse  and 
evaluate  all  drills 

•-'*  .r.els 
-  ■  ■  ,•  irnall 
•ersn.f’ 

-j  lir.'ern.'i, 

Utilization  R«rvi<w  Pro-am 
< Uriti zacion  Review  Standard  1) 

Address  oyerutiliaat'on,  indurutilitation.  and  ine'fieient 
scheduling  ol  rasourcti 

.j'  4nd 

•  ,r .  of  undoing 

Delineate  responsibilities  lot  ditch  art]#  planning 

SUPPORT  SERVICE  EVALUATION  FUNCTIONS 

PERTINENT  CHAPTER 

SOURCE  OF  EVALUATION 
* 

.'Jt.N'CY 

Anttthtiia  Service*  - 
(Standard  1)  <  s  . 

Preestablished  criteria  1  \*.\ . 

i 

Oiatitic  Serviea* 

(Standard  VI) 

Input  ot  medical.  nuMing,  and  dietetic  staKs 

Outsitit  tourcet  it  uted 

Medical  record 

libil  i 

emergency  Services 
'Stand*")  VI'I) 

Preesiabnshed  criteria 

Use  ot  medical  record 

•' th*y 

fr«*\.#nt!y 
pl.r  ■  -»r 

rr-Cv.  *■  /I 

Home  Cjft  Services 
, Standard  V) 

Patient  records,  both  active  and  cloud 

-■  The  ttandard 

-■  ■  iu  res  annual 

.  t  „  jt*ort  jf  protjnm 

•  -.Wets  by  a  mum* 
Jiictplinary  advisor/ 
.Qir,r-*i»tce  and  re/*ev/ 
v  o.v»*nr  care  OUrs 
l  '»f  ‘*'1'  *1  VOUtnt ly 

't'  ;n  GO  cis/s  | 

Hospital-Sponsored 

Ambulatory  Car* 

Service*  (Standard  V!| 

Pr-*H»rahl 'vied  criteria 

' 

list  ol  medical  record 

| 

•  c?  at  r*  Jrfily  I 

•l  /'f  *  »  i  v.nriy  wh*n 
•ptvira  •  aroam;«d  by 
M'rw'Ty  services  o*"  has 
tufrtnch  or^orami 
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SUPPORT  SERVICE  EVALUATION  FUNCTIONS 


PERTINENT  CHAPTER 

SOURCE  OF  INFORMATION 

FREQUENCY 

*Jud#v  Medium#  S*r*ic»i 

’SlJrtdJrd  11 

Review  and  evaluation  at  services  provided  as  documented 
by  director 

t-ior  specified 

Pathology  >«'d  Medical 
laboratory  Services 
'Standard  1) 

Review  end  evaluation  o'  the  quality  and  appropriateness 
ol  services  rendered  by  the  director 

Nut  specified 

Pharmaceutical  Services 
(Standard  III) 

Pirfcipition  ay  phai  icitl  m  tnose  atoacts  ol  the  overall 
quality  assurance  program  that  relate  to  drug  utiliraticn  and 
effectiveness 

•  lot  specified 

Radiology  Services 

IStindird  1) 

Review  and  evaluation  ol  quality  and  appropriateness  of 
radiologic  services  by  director 

Mot  specified 

Rehabilitation  Program 

Services 
(Standard  1) 

Pretitablisheti  criteria 

Involvement  of  medical  staff  and  rehabilitation  personnel 

Quarterly 

Respiratory  Cara  Services 
iStandard  VI) 

Preestablished  criteria 

Involvement  of  medical  staff  and  respirator/  care  personnel 

Use  of  medical  record 

Quarterly 

Social  Work  Services 
(Standard  V)-  •  •  -  • 

• 

Prceitabliihed  criteria 

Usa  of  medical  record 

Outsida  services  if  used 

Twiea  annually 

Spicial  Car*  Uniti 
(Standard  III 

Review  and  evaluation  of  the  quality,  safety,  and  aopropriatmeii 
of  the  patient  care  within  the  unit  as  related  to  the  findings  of 
hospital  and  medical  staff  quality  and  ssfety  assessment  activities 

Regularly  by 
physician-director 

Quarterly  by  multi- 
diss.piinary  committsu 
Cor  a  multiourpota 
special  care  uniti 

NURSING  EVALUATION 


ACTIVITY 

FUNCTION 

FREQUENCY 

Oeoartment/Service  Meetings 

Identify  problems;  propose  solutions 

At  least  six  times  a 

(Nursing  Services  Standard  III 

yo*r 

(May  be  performed  on  depart- 

Consider  findings  from  relevant  nursing  care  and  monitoring 

ment/scrvice/unit  level) 

activities 

Review  and  Evaluation  of 

Examine  the -provision  of  nursing  care  and  its  effect  on 

At  least  nueferly 

Nutting  Prictict  *nd 

F'jnctiom 

pat  itnti 

(Nursing  Services  Standard  VII) 

ipe'formed  by  department/ 

.Tev**»w  Quality  jnn  ,inDrouriat*n»u  of  car*  pro«icJfrJby  nurunq 

service  as  a  whole,  by 
designated  representative 
committee,  or  by  nursing 

personnel  who  t.<*  not  hospital  employ*** 

staff  assigned  todeoart- 

ments/'.erviees/units) 

F-2 
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MEDICAL  STAFF  EVALUATION,  ASSESSMENT,  AND  MONITORING  ACTIVIT'ES 


ACTIVITIES 

FUNCTION 

FREQUENCY 

executive  Cominii’nt 

Receive  and  act  ppnn  reaorts  and  r»corTWT'*r>.lation$  fr.-in  medical  lial* 

Monthly 

(Medical  Suit  Standard  III 

committee!,  deportment!,  servires.  irid  av.-ined  activity  groups 

Medical  Stiff  Oipartmtnts 

Review  pitiantcara  and  treatment 

Monthly 

l.:»iMrimtntaiirifd  staff)  o' 

Staff  (nortl*Diam«nuiii-d 

Maintain  record  that  include!  retultant  rtcommendatlnns, 

Staff) 

conclusion!,  and  action  instituted 

U.lrdieal  Staff  Standard  III 

Oiiiqnifed  Mtehaniimi  th# 

Evaluate  patient  care  through  specific  studies  using  preustablisned 

As  indicated 

Medical  Sufi 

r.rittff* 

iMedica*  St«lf  SramJifd  IV) 

Monitor  elements  of  patient  care  identified  in  staff  nr  department.1 
service  rules  and  regulations 

Continuc«js4v 

TIjju*  Review  Function 

Perform  review  on  casts  in  which  a  soecmitn  (tissue  or  nontissue) 

Monthly 

'.Surgical  can  review) 

was  removed,  as  well  as  casts  in  which  no  specimen  was  removed 

Fh>rm;^  and  T'terapr  jr  c; 

Ce.'.lop  snd  s  rvey  ;kvmacy  snd  thersp.  jt'c  oc'.’ies  ard 

Qua.  f'yor 

function 

procedures  rented  to  the  selvcvon,  mtrahospitei  distribution 

more  frenuently 

(Set  also  Pharmaceutical 

and  handling,  and  sale  administration  of  drugs 

Service!  Standard!  Ill  V) 

Evaluate  and  approve  ali  protocols  concerr  mg  use  ol  investigational 
or  experimental  drugs 

Medical  Record  Function 

Review  medical  record!  for  timely  tompfs'iou,  -.finical  pertinence. 

Ouert*'1'/ or 

(St*  alio  Medical  Record 

and  gyeiatt  adequacy  for  quality  atsutanot  activities 

more  frequently 

Service*  StandardiJ  •  III) 

* 

Blood  Utlliea'Jon  Review 

Review  blood  transfusions  for  proper  util  wtion  with  proper 

Quarterly  or 

attention  to  use  of  whole  blood  versu.  eoii'iaonvit  blood 
elements 

more  frequently 

Evaluate  olood  use,  including  a  rev  v*  ol  '  :  vmc  '.nt  ol  blood 
requested,  amount  used,  and  amount  af  wantage 

Antibiotic  Usage  Review 

Establish  criteria  for  propnylact'c  end  therapeutic  use  of  antibiotics 

Ongoing  useq* 

m  problem  areas  ana  review  departures  from  thesit ertten* 

jnetif^tnr 
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4.  Grit-, 
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- t f ted :  (Departirent,  comroicree.  complaints,  etc.} 

(s)  of  Study: 

(Examples:  JCAH  Standard!,  SCO's,  AR't,  Local  staff  consensus  or 
t,  etc. 1 

.  Tec.;  i  rad : 

•v.el  (List  recommendations.  cr  •w'tv.nnel  to  conduct  study} 

(Rsttrfiats  the  t (me  needed  to  ovi-.xt  study  and  report  findings} 

''ent/Suppl  .'as  ( Estimate  cos-s,  *.  Y  .'pal  {cable) 

■  (List  other  departments  ir.vol  ■■ri  and  list  other  pertinent  resource  cevts  net 

■  ?«i c  i  hen) 

«-d  Priority:  (Within  derarer’ert  'rosptCal  or  otner.  Discuss  impact  if 
•t  studied} 

Tents :  f If  any} 


Chief,  Department  or  Committee' 


FROM  CPS  DATE 

XQ  or  Executive  Committee 


CUT  2 


1,  S'  ,  ipproved/disapproved/aeferreo  is  snis  time.  NOTE:  IF  APPROVED,  THE  PRIORITY 
ASS! AM  •  .  .  BE  NOTED.  MTE;  rF  STUDY  IS  DISAPPROVED  OP, “DEFERRED  THE  REASON  WILL  BE 

I  <T.*.T''r' 


2.  Cha  for  study  is 


Others  on  committee  are 


,  etc. 


3.  Depvsvnts  involved  in  study:  (Specify) 

4.  Const  lints:  (Optional  paragraph.  Example;  Constraints  on  resources] 

5.  Suspense  data  for  completion  of  study  is:  (Specify) 


v-.5xv  |A P P E N D I X  A 

DA  THOU  2496 


CPS  or  XQ 


KtPUACeS  OO  FOAM  99.  WHICH  IS  OMOUeTS. 


•luniXiA-rj.  v.  * v 
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REVISED  QUALITY  ASSURANCE  PLAN 


•MEDDAC  Memo  40-91 


DEPARTMENT  OF  THE  ARMY 
Headquarters,  US  Army  Medical  Department  Activity 
Fort  Belvoir,  Virginia  22060 


Memorandum 

No.  40-91  l  March  1982 


Medical  Services 
QUALITY  ASSURANCE  PLAN 

1.  Purpose.  The  purpose  of  this  memorandum  is  to  establish  a  written  plan  that  will 
serve  as  basis  for  a  comprehensive,  fully  integrated,  problem-focused  approach  to  a 
Quality  Assurance  (QA)  Plan  for  US  Army  Medical  Department  Activity,  Fort  Belvoir, 
Virginia. 

2.  General.  The  overall  goal  of  the  Quality  Assurance  Program  (QAP)  is  to  demonstrate 
this  MEDDAC's  comprehensive  and  integrated  approach  to  quality  assurance.  The 
principal  objective  of  the  QAP  is  to  facilitate  the  ongoing  identification  and  assessment 
of  problems  associated  with  clinical  performance  and  the  delivery  of  health  care  with  the 
intent  of  improving  such  care  to  an  optimal  level  within  available  resource  constraints. 

3.  Scope.  The  QAP  involves  all  organizational  activities  that  are  designed  to  foster  or 
evaluate  health  care.  It  includes  all  departments,  disciplines,  practitioners,  ancillary 
personnel,  and  administrative  personnel  assigned  or  attached  to  the  MEDDAC,  Fort 
Belvoir.  Health  care  providers  will  participate  in  peer  review  and  all  patient  care 
processes  will  be  subject  potentially  to  evaluation. 

4.  Responsibilities. 

a.  The  MEDDAC  Commander  is  recognized  as  the  delegated  and  ultimate  authority 
to  represent  the  governing  body  (OTSG)  at  the  local  level.  As  such,  he  holds  the  ultimate 
responsibility  for  quality  assurance  activities  within  the  MEDDAC. 

b.  The  Executive  Officer  is  responsible  for  administrative  actions  in  support  of  the 
QA  Plan  and  for  insuring  the  availability  of  resources  necessary  to  carry  out  the 
provisions  of  said  plan. 

c.  The  Chief,  Professional  Services  will  serve  as  chairman  of  the  QA  Coordinating 
Committee.  He  has  the  authority  to  direct  such  actions  as  are  deemed  appropriate  to 
achieve  the  goal  of  the  QAP. 

d.  Division/department/activity  chiefs,  to  include  the  OiC's  of  Fort  A.  P.  Hill  and 
Vint  Hill  Farms  Station  Health  Clinics,  are  responsible  for  implementing  the  procedures 
outlined  in  paragraph  5  below. 

e.  The  QA  Coordination  Committee  (see  organizational  chart  at  Annex  A)  will  be 
responsible  for  the  following: 

(1)  Overseeing  all  aspects  of  the  QAP,  to  include  reviewing  current  QA 
activities,  setting  priorities  on  MEDDAC-wide  QA  actions,  and  directing  actions  to  be 
taken  in  resolving  identified  QA  problems. 


♦This  Memorandum  supersedes  MEDDAC  Memorandum  40-91.  dated  22  December  1980. 
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(2)  Reviewing  and  evaluating  the  QA  Plan  annually  during  the  month  of 
December.  During  the  annual  review,  this  memorandum  will  be  updated  and/or  revised  as 
necessary.  Documentation  of  the  annual  reassessment  will  include  a  list  of  problems 
identified  during  the  past  year  and  a  summary  statement  as  to  the  program's  impact  on 
improving  clinical  performance  and  health  care.  The  above  documentation  will  be  made  a 
part  of  the  minutes  of  the  December  QA  Coordinating  Committee  meeting. 

f.  All  MEDDAC  personnel  must  abide  by  the  procedures  established  herein,  remain 
cognizant  of  any  problem  which  has  or  could  have  a  negative  impact  on  the  delivery  of 
optimal  feasible  health  care,  and  communicate  said  problems  to  the  QA  Coordinating 
Committee. 

5.  Procedures. 

a.  Each  division/department/activity  chief  will  establish  a  QAP  to  assess  health 
care  and  identify  QA  problems  within  their  own  areas  of  interest  and/or  in  other  areas  of 
the  MEDDAC.  The  functioning  of  this  program  will  be  based  on  guidance  provided  by  this 
memorandum  and  will  be  outlined  in  an  internal  SOP.  Copies  of  a  sample  QA  SOP  (Annex 
B)  and  minutes  of  a  departmental  QA  meeting  (Annex  C  without  inclosures)  are  attached. 
Departmental  QA  meetings  will  be  conducted  on  a  regular,  but  not  less  than  quarterly, 
basis.  Copies  of  minutes  of  departmental  QA  meetings  will  be  routed  to  the  QA 
Coordinating  Committee.  Intradepartmental  problems  identified  for  further  study  will  be 
reported  to  the  QA  Coordinating  Committee  by  completing  Sections  I  through  III  of 
MEDDAC(CSD)  Form  522  (see  Annex  D).  QA  problems  thought  to  extend  beyond  the 
preview  of  individual  departments  will  be  recorded  in  Section  1  of  MEDDAC(CSD)  Form 
522  and  forwarded  to  the  QA  Coordinating  Committee  for  action. 

b.  The  committees  and  support  services  listed  at  Annex  E  will  forward  an 
information  copy  of  their  minutes/periodic  reports  to  the  QA  Coordinating  Committee. 
Applicable  3CAH  evaluation  criteria  and  reporting  frequency  is  specified  at  Annex  F. 
Committee  minutes/report  format  will  include  a  paragraph  summarizing  QA  issues 
addressed.  QA  problems  identified  for  further  study  will  be  reported  as  specified  in 
paragraph  5a  above. 

c.  An  individual  identifying  a  potential  QA  problem  may  report  the  problem  in  one 
of  two  ways: 

(1)  To  his/her  department/di  vision  chief  for  inclusion  into  the  departmental  QA 
meeting  or 

(2)  Directly  to  the  Chairman  of  the  QA  Coordinating  Committee  (CPS). 
Format  io:  this  report  will  be  as  described  in  paragraph  5a  above. 

d.  Upon  receipt  of  MEDDAC(CSD)  Forms  522  by  the  QA  Coordinating  Committee, 
identified  problems  will  be  reviewed,  evaluated,  and  prioritized  with  regard  to  the  order 
in  which  assessment  will  take  place.  The  QA  Coordinating  Committee  will  direct 
comprehensive  integration  of  problems  to  all  interested  departments/divisions/activities 
and  assign  responsibility  for  problem  resolution.  The  QA  Coordinating  Committee  will 
direct  appropriate  follow-up  action  through  its  committee  review  process  and  will 
periodically  monitor  problem  resolution.  Ail  problem  resolutions  will  be  evaluated  during 
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the  annual  review.  Administrative  operation  of  the  Q A  Coordinating  Committee  will  be 
governed  by  the  provisions  of  MEDDAC  Memorandum  15-1. 

6.  References. 

a.  AR  40-66,  Chapter  9,  "Quality  Assurance" 

b.  JCAH  Accreditation  Manual  for  Hospitals 

c.  MEDDAC  Memorandum  15-1,  MEDDAC  Committees,  Boards,  Councils,  and 
Conferences 

HSXA-AR 

FOR  THE  COMMANDER: 
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as 


DISTRIBUTION: 

A 


MARGARET  A. 


CRT,  M SC 
Adjutant 
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ANNEX  B  DEPARTMENT  OF  THE  ARMY 

Headquarters,  US  Army  Medical  Department  Activity 
Fort  Belvoir,  Virginia  22060 

HSXA-FP  1  December  1981 

Quality  Assurance  Program  for  the  Department  of  Family  Practice 

1.  Purpose.  To  establish  guidelines  for  reviewing  and  evaluating  the  quality  and 
appropriateness  of  inpatient  and  outpatient  services  within  the  department. 

2.  Scope.  Family  Practice  Inpatient  Services,  Family  Practice  Clinic,  DeWitt  Army 
Community  Hospital,  Fort  Belvoir,  Virginia. 

3.  Responsibility.  It  is  the  responsibility  of  the  Chief,  Department  of  Family  Practice, 
through  the  Family  Practice  Clinic  Director  and  the  Inpatient  Faculty  Coordinator  to 
conduct  a  review  and  evaluation  of  the  quality  and  appropriateness  of  the  inpatient  and 
outpatient  services  given  within  the  department  on  a  monthly  basis.  This  will  be 
accomplished  by  the  auditing  of  patient  medical  records  by  pre-established  criteria. 

4.  General.  The  criteria  to  be  utilized  in  the  review  will  be  of  four  types  or  categories. 

a.  Ongoing  daily  usage  of  Inclosure  1  titled  "Medical  Record  Audit"  examining  the 
resident  physicians'  capability  in  his/her  ongoing  medical  care  of  patients.  This  will 
include  the  thoroughness  of  the  record,  the  analytical  sense,  the  reliability  and  the 
efficiency  of  the  care  delivered.  This  form  will  be  utilized  to  evaluate  the  ongoing, 
overall  continuity  and  quality  of  patient  care  rendered  by  the  resident  physician. 

b.  Quarterly  audits  by  disease  category;  matching  residency  physicians  to  disease 
category  and  utilizing  the  Family  Practice  Computer  Management  System  in  identifying 
patient  category  type.  Audits  planned  for  calendar  year  1982-83  will  include  "diabetes" 
and  "hypertension"  and  will  match  resident  physician  to  these  categories  (see  Inclosure  2 
and  3). 

c.  Monthly  audits  of  pre-selected  patient  types  and  disease  categories  for  all 
physicians  (staff  and  residents)  preselected  by  the  department.  These  records  will  be 
audited  by  pre-selected  criteria  on  a  daily  or  weekly  basis  by  staff  physicians. 

d.  Monthly  audits  of  completed  inpatient  records  of  patients  hospitalized  on  the 
Family  Practice  Inpatient  Services.  These  will  include  medical,  pediatric,  obstetrical  and 
gynecologic  patient  categories.  Audits  will  be  conducted  once  monthly  at  the  Patient 
Care  Auditing/Quality  Assurance  Departmental  Meeting.  Records  will  be  reviewed  by 
criteria  listed  in  lnclosure  4  and  charts/records  reviewed  will  be  coordinated  through  the 
Patient  Administration  Division,  DeWitt  Army  Community  Hospital  by  the  Inpatient  Staff 
Coordinator. 

3.  Reporting.  Reporting  of  all  audit  results  of  all  categories  will  be  the  responsibility  of 
the  Chief,  Department  of  Family  Practice.  Results  will  be  reported  to  the  Patient  Care 
Auditing/Utilization  Committee  and  to  the  Quality  Assurance  Committee  on  a  monthly 
basis. 

6.  Problem  Areas.  Problems  identified  in  the  above  described  audits  will  be  so  recorded 
utilizing  the  "Quality  Assurance  Problem  Worksheet"  (lnclosure  >).  Problems  uncovered, 
solutions  proposed  and  undertaken,  and  the  results  of  re-auditing  will  be  reported  to  the 
Hospital  Quality  Assurance  Committee  with  this  form. 


William  .1.  Mcinert 
LTC,  IMC 

Chief,  Department  of  Family  Practice 
B-l 


.  "DEPARTMENT  OF  THE  ARMY 
DeWItt  Army  Community  Hospital 
Family  Practice  Center 
Fort  Bel  voir,  Virginia  22060 


MEDICAL  RECORD  AUDIT 

'  Patient's  Name:  _ ' _ *  Date:'  _ 

•  t 

Physician's  Name:  . _ _ 

Auditor's  Name:  _ _ 

Is  chart  legible:  _ Yes  _ No 

1,  Thoroughness: 

YES 


NQ 


a.  Complete  Data  Base  _  _ 

b.  Problem  list  complete  and  up-to-date 

c.  Plan  written  for  each  significant  problem  _  _ 

d.  Patient  profile  in  chart  _  _ 

e.  Medication  list  complete  and  up-to-date  _  _ 

f.  Overall  rating  of  thoroughness  of  record  ' 

Excellent  _ Satisfactory  _ Borderline  _ Unacceptable 

2.  Analytical  Sense: 

a.  Clear,  cogical  treatment  plan  of  acceptable  _  _ 

quality  for  each  problem 

b.  Proper  consultations  for  problems  _  _ 

c.  Is  each  problem  supported  by  adequate  data,  _  _ 

and  the  need  for  further  data  recognized 

d.  Abnormal  findings  noted  in  chart  (explained)  _  _ 

e.  Overall  Rating: 

_ _ Excellent _ Satisfactory  _ Borderline  _ Unacceptable 
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3.  Reliability: 


YES  .  NO 


•.a.', Were  problem  plans.  Implemented 

b.  Were  additional  tests  and  procedures  indicated 
actually  performed 

c.  Overall  Rating: 

*  »  4 

_ Excellent  _ Satisfactory  _ Borderline 


Unacceptable 


4.  Efficiency: 

a.  Were  paramedical  personnel  utilized,  if.  necessary  _ 

b.  Do  flow  sheets  exist  if  necessary  to  deal  with 

complicated,  inter-related  problems  _  _ 

c.  Did  physician  time  spent  seem  appropriate 

for  problem  stated  _  _ 

d.  Were  "inappropriate"  or  "unnecessary"  lab 

or  x-ray  studies  performed  _ 

e.  Overall  Rating: 

_ Excellent  _ Satisfactory  _ Borderline  _ Unacceptable 


R-n 
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DIABETIC  CHART  AUDIT 


Patient: _ _ _  Chart  # 


Physician: 


;«W 


1.  Problem  List 

2.  Medication  List 

3.  Documentation 

a.  Ophthalmology  consult 

b.  Podiatry  consult  * 

c.  Instruction  in  insulin  usage  or 
oral  hypoglycemics  if  given  * 

d.  Dietary  consult  * 

*  or  documentation  of  being  performed  by 
primary  physician 

4.  Follow-up  visit  ever  2-3  months  if  on 
insulin  or  hypoglycemics;  every  6-12 
months  if  diet  controlled 

5.  Basic  laboratory  data:  Renal  function 
test,  lytos,  CBC,  urine,  urine  culture 

6.  Recurrent  laboratory  data:  FBS  (lower 
than  200) ,  urine  S/A 

7.  P.E.:  Fundus,  BP,  C.V. ,  Skin  Peripheral 
Sensation,  DTR 


Overall  evaluation  Acceptable  |  |  Hruiecoptahle  □ 

Comments: 


Evaluating  physician: 


^  TO  Form  3^8 
18  Dec  80 
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This  Document 
Reproduced  From 
Best  Available  Copy 


MEDIC AI  RECORDS  AUHTT— HYPERTENSION 


Pat  i  ont 


Date 


Social  Recur i tv  -■ 


T5hw 


ysician 
Evaluator 


Chock 


complete 


Check  i~  comoletc 


_  Problem  l  ist 

_ Medications  Recorded 

_  Eymptomatolocy  checklist 

Physical  Exam 

_  Ophthalmoscope  exam  once/year 

_ Cardiovascular :  heart,  rate,  rhythm, _ 

murmur,  peripheral  nulses,  presence/  _ Serum  cruatirate 

absence  of  bruits  _  Triolvcer tries 

Periodic  Laboratory  EEC- 


Laboratory  and  Consultation 

_  Ophthalmology  consult 

_ CBC 

_  UA  c  CCS 

_  Electrolytes  Na,  K,  Cl,  CO^ 

Eastinq  SKA- 12 


'•:l  cctrolvtes :  q  0-12  mos  K  q  2-3  wks 
P  start  or  chancre?  or  diuretic 
I'.KC:  (;  year  or  prn  c  PC's  of  CHF 
Eric  Acid:  q  2-3  wks  n  start  or 
chanqe  of  EX 


CXR 


■  I'  *  or : 


■  'omr.eiitr 


24  Hour  Crxt.ar y  creatinine 
i  f  non,  to  rum.  creatinine 

protein  _  if  aim,  CA  (hx  of 

renal  dr:,  protein  or  BBC's  in  urine) 

17  OH  ft  17  :<s  _ i. '  Cashier's, 

sires  &  synijtons 

VC  A  ^  i c  postural  hypo- 

tei,:;  ion  ,  f  1  u::h  :  r.u  ,  'achy  oardia,  dia- 


caoresi s 
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h'yporhens : ve  :vp  if  over  40  years  oH 
Renal  artcrioqram,  ^enal  renins  if 
kidney  sixp  asymmetr ical 

Unacceptable 


OBSTETRICAL  PATTEMT  CTE  AUDIT 


Date  , 

Chart  I  _________ 

•Auditing.  Physician 


1)  . Patient  ID  Data 

2)  EEC,  L2!?i?»  or  corrected  EDC 
recorded  in  chart 

3)  •  Appropriate  data  for  each  visit 
••  recorded  (wt,  BP,  urine,  etc) 

4)  tab  Data  on  chart 

Type,  Rh,  Kct,  H?b,  PAP.  smear, 
Serolooy 

5)  Review  of  Systems  Analysis 

fc)  Past  Medical  History  and  Family 
History 

7)  Previous  obstetrical  record 

8)  Complete  P.E. 

9)  Pelvic  Exam  with  Obstetrical 
Prognosis 

10)  Chart  legible 


Cements: 


Overall : 


Acceptable 


Unacceptable 
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QUALITY’ ASSURANCE  PROGRAM 
PROBLEM  ASSESSMENT  WORKSHEET 

'•/  . 

• 

.*  *  *: 

Problem  No. 

Date 

SECTION  I  -  IDENTIFICATION 

1.  Statement  of  Problem;. 

,  «  ♦  ••  •  #  >.  •'  •  %  *  • 

I  *  •  *  t  *  •  .  .*  *  . 

2.  Source  of  Data:  ' 

3.  Committee/Office/Individual  Identifying  Problem: 


SECTION  II  -  ASSESSMENT  Date 

1.  Identify  Applicable  Criteria:* 


2.  Feasible  Resolutions: 


3.  Recommended  Resolution: 


4.  Resources  Required: 


L- g 


» 


.*■ 

i 


I 


I 


S 


SECTION  111  -  EXECUTIVE  REVIEW  Date 


3 

j 


j 


1.  Action  Taken: 

i 


2,  Priority:  _  Immediate  -  Resolve  within  30  days  -  review  monthly. 

_  Delayed  -  Resolve  within  6  months  -  review  monthly. 

_  Long  Range  -  Resolve  within  5  years  -  review  annually. 

_  Deferred  -  Resolution  not  feasible  with  current  resources  - 

review  annually. 
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5ECT10N  IV  -  IN  PROGRESS  REVIEWS 


1.  Status: 


Date 


>.  '  .. 

2.  Status: 


v  '  ■ 


Date 


»•  .*i  #,f  •  ,i.  *4 •♦  *  j  y ■  ,s  ••V' V*  ♦ 

3.  Status: 


V  • 


....  p  • 

Date _ - 


4.  Status: 


I 


Date 


3.  Status: 


Date 


SECTION  V  -  RESOLUTION 


Statement  of  Resolution: 


Date 


SECTION  VI  -  FOLLOW-UP/REVIEW 


Date 
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DEPARTMENT  OF  THE  ARMY 
HEADQUARTERS.  U.  S.  DEWITT  ARMV  HOSPITAL 
FORT  GELVOIR.  VIRGINIA  22060 


16  December  1981 


SUBJECT:  Mir.utes  of  the  Department  of  Family  Practice  Patient  Care  Auditing 
and  Quality  Assurance  Committee  Meetings 


Chairman 

Medical  Care  Evaluation  &  Quality  Assurance 
DeWitt  Army  Community  Hospital 
Fort  Bclvoir,  Virginia  22060 


1.  The  meetings  were  held  on  9  December  198*1  at  1230  hours  in  the  Main 

Conference  Room. 

2 .  Members  Present : 

OPT  John  H.  Black,  Chairman,  Patient  Care  Auditing  Committee 
LTC  William  J.  Meinert,  Chairman,  Quality  Assurance  Committee 
Staff  Members: 

CPT  Robert  Campbell 
CPT  William  McCarbcrg 
CPT- Mark  Hillard 
Resident  Members: 

CPT  Steve  Daugherty,  Lst  year 
CPT  Janet  Spitzer,  lst  year 
CPT  Steven  Reissman,  1st  year 
CPT  Laurence  Sharp,  lst  year 
CPT  Neal  Baillargeon,  2nd  year 
CPT  Mark  Beckerman,  2nd  year 
CPT  Eric  Brewner,  2nd  year 
CPT  Douglas  Cambier,  2nd  year 
CPT  John  Roasoner,  2nd  year 
CPT  John  Alves,  3rd  year 
CPT  Gerald  De  Tata,  3rd  year 
CPT  John  Pascal,  3rd  year 
CPT  Doug  la-  Phillip,  3rd  year 
Members  Exe used  or  Absent : 

Major  John  Fogarty,  Staff 
Major  R.  B.  Stilh,  Staff 
CPT  Joseph  Fitzllarris,  Staff 
CPT  Robert  Keade,  3rd  year 
MAJ  Thomas  Ely,  3rd  year 
CPT  Wayne  Jonas,  1st  year 
CPT  James  MeGluc,  1st  year 


I  M 
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i 
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SUBJECT:-  Minutes  of  the  Department  of  Family  Practice  Patient  Care  Auditing 
and  Quality  Assurance  Conmittee  Meetings 

3.  Old  Business: 

None.  This  is  the  first  meeting  held.  Family  Practice  Inpatient  Service 
was  established  19  October  1981. 

4.  Mew  Business — Chart  Review. 

a.  Reviewed  25  completed  inpatient  records  to  include  obstetrical,  gynecologic, 
medicine  and  pediatric  type  admissions.  The  following  deficiencies  were  noted  in 
these  records. 

(1)  Discussed  the  chart  of  a  45  year  old  WM  admitted  to  the  ICU  with  the 
diagnosis  of  shortness  of  breath,  wheezing  and  possible  pulmonary  embolus.  A 
deficiency  existed  in  the  record  in  that  a  specialized  procedure  was  not  coded 

on  the  cover  sheet,  "VQ  scanning",  and  the  diagnqsis  of  "Medical  observation  for 
possible  pulmonary  .embolus ,  suspected,  not  proven"  was  not  listed  on  the  cover 
sheet.  Record  returned  to  PAD  for  additional  coding. 

(2)  Discussed  the  chart  of  a  2  y/o  WM  whose  parent  removed  the  child 
from  the  hospital  against  medical  advice  for  the  problem  of  wheezing.  No  mention 
is  made  of  this  on  the  cover  sheet— returned  to  PAD  for  additional  coding. 

(3)  Discussed  the  record  of  a  1  y/o  BM,  admitted  with  potential  child 
neglect.  No  discharge  instruction  sheet  could  be  found  in  the  record.  Tnis  was 
considered  a  major  deficiency  in  view  of  the  CPMCT  and  ncdieo-legal  aspects  of 
the  case.  Chart  was  returned  to  the  physician  for  appropriate  notation  as  to 
disposition  and  followup. 

(4)  Discussed  the  record  of  a  25  y/o  BF,  admitted  to  the  ICU  with  asthma. 
No  mention  was  made  in  the  chart  of  the  results  of  several  blood  gases  drawn 
during  the  admission.  The  necessity  of  comment  by  the  physician  who  orders  lab, 
x-ray  tests  in  the  progress  notes  was  emphasized. 

(5)  Discussed  the  record  of  a  28  y/o  WF  admitted  for  an  incomplete 
abortion  who  underwent  an  elective  D&C.  No  tissue  pathology  report  was  in  the 
chart  after  1  month.  This  was  considered  inappropriate  and  the  chart  was  returned 
to  PAD  for  filing  of  the  tissue  result. 


(6)  Discussed  the  record  of  a  61  y/o  Wit  admitted  to  the  CCU  on  a  "R/0  MI 
protocol".  No  mention  is  made  of  the  results  of  a  CXR  done  on  admission.  Returned 
io  physician  for  correction  or  addendum  to  the  record. 


(7)  Discussed  the  chart  of  a  48  y/o  WM,  admitted  to  ICU  with  asthma. 
Again,  no  mention  of  a  CXR  done  on  admission. 

(8)  Discussed  the  chart  of  a  24  y/o  Wt' ,  postpartum,  augmented  with 
pitocen  after  5  hours  of  SROM.  There  was  no  mention  as  to  the  indications  for 
augmentation  or  whether  a  staff  OB-GYN  person  was  consulted  regarding  the  drug 
usage.  Chart  returned  for  addendum  to  notations. 
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HSXA-FP 

SUBJECT:  Minutes  of  Che  Department  of  Family  Practice  Patient  Care  Auditing 
«  and  Quality  Assurance  Committee  Meetings 

b.  Current  Inpatient  Chart  Review:  Census  on  the  Service  numbered  four  at 
the  time  of  the  audit.  All  charts  had  been  reviewed  and  various  deficiencies 
were  corrected  at  the  time  of  the  review  by  the  physician  in  charge  of  the 
patient's  care. 

c.  There  were  no  recorded  deaths  in  the  Family  Practice  Inpatient  Service 
since  19  October  1981. 


d.  Complications:  No  introgenic  complications  could  bo  found  or  were  re¬ 
corded  in  patient  care  during  the  review. 

e.  Outpatient  Chart  Review:  Formal  Outpatient  Chart  Review  has  been  in 
effect  within  the  Family  Practice  Clinic  as  of  l  December  1981.  The  audits  will 
follow  the  format  illustrated  in  the  SOP  titled  “Quality  Assurance  Program  for 
the  Dept  of  Family  Practice" ,  dated  December  1981  (Incl  vl).  Audits  planned 
for  December  will  utilise  the  "Medical  Record  Audit"  daily  (Incl  '!2)  on  selected 
Resident  charts.  In  addition,  a  generic  audit  will  be  conducted  on  all  the 
Family  Practice  obstetrical  records  utilising  Incl  f-3,  "ObstetTical  Patient 
Care  Audit."  Results  of  all  these  audits  and  statistics  gathered  will  be  re¬ 
ported  in  the  January  minutes  of  this  Committee 

5 .  Quality  Assurance  Program — Problem  Assessment . 

a.  The  entire  QA  Program  of  the  Department  was  explained  and  clarified  to 
members  of  the  department,  as  well  as  the  utilization  of  the  Problem  Assessment 
Worksheet . 


b.  The  first  QA  Problem  identified  from  the  Inpatient  Records  Audit  was  the 
high  percentage  of  charts  (30",)  which  were  identified  as  deficient  because  of 
the  physician's  lack  of  documentation  regarding  pertinent  lab,  x-ray  and  other 
data.  The  feeling  of  the  majority  of  the  members  was  that  "if  a  lata  test  is 
important  enough  to  be  ordered,  some  mention  of  its  results  should  be  made  in 
the  progress  notes".  This  statement  was  expanded  to  include  other  facets  of 
the  patient's  carc--to  include  the  results  of  consults,  physical  therapy  and 
respiratory  therapy,  bee  Incl  f')4  for  reccnuncudat  ions . 


6. 


Meeting  adjourned  at  1335  hours. 


WILLIAM  J.  ME INERT,  M.D. 

LTC ,  MC 

Chairman,  Quality  Assurance  Committee 
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ANNEX  D 


QUALITY  ASSURANCE  PROGRAM 
PROBLEM  ASSESSMENT  WORKSHEET 


SECTION  I -IDENTIFICATION 

A.  Statement  of  Problems: 


Date 


B.  Source  of  Data: 

C.  Conroittee/Office/Individual  Identifying  Problem: 

D.  Recommended  Individual/Conmittee/Activity  to  investigate  Problem: 


SECTION  I I -ASSESSMENT  Date 

A.  Identify  Applicable  Criteria; 

B.  Feasible  Resolutions: 

C.  Recomnended  Resolutions: 

D.  Resources  Required: 


SECTION  Ill-Executive  Review  Date 


A.  Action  Taken: 


B.  Priority:  _ Inmediate-Resolve  within  30  days- review  monthly. 

_ Delayed-Resolve  within  6  months- review  monthly. 

_ Long  Range-Resolve  within  5  years-review  annually. 

_ Deferred-Resolution  not  feasible  with  current 

resources -review  annually. 


_  MEDDAC  (CSD)  FORM  522 
'.Vi  1  April  1982 
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SECTION  IV- IN-PROGRESS  REVIEWS 


A.  Status:  Date 

B.  Status:  Date 

C.  Status:  Date 

D.  Status:  Date 

E.  Status:  Date 


Statement  of  Resolution: 


SECTION  V- RESOLUTION 


Da  to 


SECTION  VI  -  FOLLOW-UP/  REV  I  liW 


Date 


I 
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ANNEX  E 


I  COMMITTEES  MONITORED  BY  QA  COORDINATING  COMMITTEE 

ACCREDITATION 

AMBULATORY  PATIENT  CARE 

EMERGENCY  MEDICAL  SERVICES 

BLOOD  TRANSFUSION  <Sc  TISSUE 

CANCER 

CLINICAL  INVESTIGATION/HUMAN  USE 

CREDENTIALS  COMMITTEE 

INFECTION  CONTROL 

ANTIBIOTIC  UTILIZATION 

MEDICAL  CARE  EVALUATION 

CARDIO-PULMONARY  RESUSCITATION 
CRITICAL  CARE 
DISCHARGE  PLANNING 

MORBIDITY  AND  MORTALITY 

RABIES  CONTROL  BOARD 

RISK  MANAGEMENT 

SAFETY  AND  FIRE  PREVENTION 

THERAPEUTIC  AGENTS  BOARD 


TUMOR  BOARD 


II.  ACTIVITIES/SERVICES  MONITORED  BY  QA  CORDINATING  COMMITTEE 


AMF  VTHFSIA 

CHN  (HOME  CARE  EVALUATION) 

DEPARTMENTAL  QUARTERLY  QA  MEETINGS 

DIETETICS 

DON  QA  PROGRAM 

FORT  A.  P.  HILL  HEALTH  CLINIC 

PATHOLOGY 

PATIENT  REPRESENTATIVE  (MONTHLY  REPORTS) 

PHARMACY 

PHYSICAL  THERAPY 

RADIOLOGY 

RESPIRATORY  THERAPY 
SOCIAL  WORK 

VINT  HILL  FARMS  STATION  HEALTH  CLINIC 
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ANNEX  F 


r 


STANDARD 


I.  Anesthesia 


2.  Dlatetlc 


3.  Entrgancy 


INVENTORY  OF  RELATED 

QUALITY  ASSESSMENT  &  CONTROL  REQUIREMENTS* 


FREQUENCY 


Quarterly 


Annual ly 


SCOPE/FOCUS 


Monitoring  to  reflect 
the  scope  of  hospital's 
anesthesia  sorvlcos 
Include  review  of  el  1 
categories  of  anostho- 
sia  personnel 
Not  I  i mi  tod  to  uor- 
hidi fy/morfal I ty  review 
Representative  snmplo 


Review  nutritional  care 
of  inpationts,  ouf- 
patlonts,  home  care, 
and  outside  contracted 
Sorvlcos,  as  appro- 
pr  i  a  f  o 

Representative  sample 
Quality  control  moeha- 
nlsms  for  specified 
procossos  such  as 
nutritional  assessment, 
dietary  Instruction, 
otc. 


Monthl y 

•  Particular  attention  to 

.  Shall  uso  modical  record 

(Recom- 

DOAs,  deaths  within  the 

and  proostab!  j  -shod 

mondod 

EO  and  deaths  wltnln 

cr 1  tor i a 

more  fro- 

24  hours  of  admission 

.  Medical  rocord  require- 

quontly  If 

from  the  ED 

moots  spec i f 1 od 

rapid  turn¬ 
over  of 
physician 
staffing) 

.  Reprnsontat Ivo  sample 
,  Quality  control  mecha¬ 
nisms  for  specified 
processes  such  as  re¬ 
call  mochanlsms,  medi¬ 
cal  record  review,  otc. 

(pp.32,53) 

CONTENTS 


Should  be  part  of  overall 
hospital  QA  program 
Medical  record  require¬ 
ments  specified  (p.6) 
Involve  uso  of  proostab- 
1 1  shod  criteria 


Should  bo  part  of  ovoral I 
hospital  QA  program 
Shall  use  modical  rocord 
and  proostab 1 1  shod 
cr i tor  la 

Review  shall  Include  con¬ 
tributions  from  nodical, 
nursing,  and  dietetic 
staffs 

‘ted  lea  I  rocord  require¬ 
ments  spocl f iod  tp.ZU) 


•Excerpts  from  Joint  Commission  on  Accreditation  of  Hospitals,  Accreditation  Manual  for 
Hospitals,  1981  Edition, 


STANDARD 


?.  Hospital 
Sponsor** 
Ambulatory 
Care 


8.  Infection 
Control 


Medical 

Staff 

(pp.io^-ioe) 

a.  Special 
Pat  lent 
Caro  Evalua¬ 
tion  Dltter- 


Blannual ly 
Recom¬ 
mended 
more  fre¬ 
quently  It 
organ  I  red 
by  service, 
have  out¬ 
reach  pro¬ 
grams,  or 
rap  I  d 
physician 
turnovor 


Bimonthly 
comm  It tea 
moot Ings 
Cont inuous 
data  col¬ 
lect  Ions, 
survel I- 
lance  and 
policy 
review 


As  indi¬ 
cated  to 
assess 
potent ial 
problems 


SCOPE/FOCUS 


.  Review  to  include 
ontlr#  scope  ot 
services  and  outside 
contracted  sorvlces, 

I t  used 

.  Representative  sample 


,  Hospitalwide 
.  Review  to  inclutlo  al  I 
patients  and  personnel 


«  Mo,  rosontut ivo  sample 


CONTENTS 


•  May  be  psrt  of  clinical 
sorv I  co/department  review 
mechan I  sms 

•  Shall  use  medical  record 
and  preostabl I  shed 

cr I  tor  I  a 

.  Medical  record  require¬ 
ment  spool f led  (p.68) 


•  Standard  criteria  for 
Identifying  and  reporting 
Infections 

•  Determine  Infection  rates 
.  System  for  data  col  lec¬ 
tion,  reporting,  anti¬ 
biotic  review  and 
evaluation  and  follow-up 
act  Ion 

,  Continuous  review  and 
evaluation  of  all  hospital 
aseptic,  Isolation  and 
sanitation  ,'echnlquoi 
.  Required  participation  by 
medical  staff,  nursing, 
administration,  and  when 
available,  microbiology 
section  of  lab 
,  Mod  leal  rocord  require¬ 
ment  specified  (p,74) 


.  Conduct  spool  tie  studios, 
os  Indicated  using  pre¬ 
ostabl  I  shod  crltorla 


STANDARD 


FREl 


SCCPE/FOCUS 


CONTENTS 


QUENCY 


f.  Anti¬ 
biotic 

Iff  egt 

Continuous 

Assessment 

,  Should  include  review 
of  Inpatients,  ambula¬ 
tory  and  emergency 
patients 

.  Representative  sample 

,  Should  Include  prophylac¬ 
tic  and  therapeutic  use 
tor  all  categories  of 
patients 

,  Cr 1  ter  Ion-based  review  in 
problem  areas 

,  Clinical  review  as  well  as 
stat  i  st  ica  I  /prove  1  ence 
studies 

.  Control  of  usage  based 
on  assessment  studies 

g.  Otter  - 
patient 
related 
profes¬ 
sional 

activities 

As  Indi¬ 
cated  by 
specific 
reviow 
activity 

.  As  Indicated  by  tho 
specific  review  activi¬ 
ties 

,  Representative  samp  la 

•  Part lc I  pat  ion  in  hospltal- 
* i do  activities  including 
planning,  safety,  etc* 

•  Patient  care  evaluation  in 
ED,  OPD,  home  care 

•  Rolo  In  car©  of  amotion- 
ally  III,  alcoholics, 
drug  abusers  clarified 

btei  Othar  required  medical  staff  functions  include  utilization  review,  (son  p.22), 

■on  I  toeing  of  clinical  policies  and  procedures,  mortality  reviow,  etc.  In  addi¬ 
tion  medical  staff  quality  control  includes  use  of  assossmont  findings  for 
credentials,  privileges  delineation  and  continuing  education  purposes  among 
other  corrective  action  options. 


10.  Nuclear 

Medicine 

•  Unspeci¬ 
fied  evalu¬ 
ation 

activities 

.  Continuous 
safety 
surve 1 1  - 

lance 

•  Review  and  evaluate 
quality,  safety  and 
appropriateness  of 

service 

,  Documented  review  and 

evaluation  of  policies/ 
procedures  and  cammittoo 

act i vi t ios 

,  Mod  leal  record  require¬ 
ment  specified  (p.  1 14) 

11.  Nursing 

Quarterly 

.  Representative  sample 

,  Should  bo  Intograted  when 
possible  with  other 
hospital  QA  activities 
,  Based  on  written  criteria 
,  Includo  nursing  care 
porsonnol  who  are  not 
hospital  employoos 
,  Variety  of  methods  can  be 
used  tor  revi ew/eva luat  ion 

STANDARD 


b»  Tissue 
(surgical 
cas«) 
Review 


EREOUENCY 


c.  Pharmacy 
and  Thera- 
pautlcs 


d.  Medical 
Record 


e.  Blood 
Utilization 


SCOPE/POCUS 


•  Includo  Inpatients  and 
outpat ients 

.  Reviou  to  includo  casus 
whore  spocimons  woro 
and  wore  not  recovered 

•  Review  all  cases  with 
major  preoporativo/ 
postoperative  dlserup- 
anclos 


•  Development  and  survoil- 
lanco  of  policies  and 
practices,  including 
drug  util  I zat ion 
.  Advlso  on  avail  able 
drugs,  formulary 
Changes,  updating  for- 
muiary,  drug  reactions 
review,  and  ovpori men¬ 
tal  drug  uso  approval 


,  Review  to  includo  in- 
patlont,  hospital- 
sponsored  ambulatory 
care,  CD  and  home  ...ire 
records 

•  Reprusontative  sample 


Roviow  to  Includo  in¬ 
patient,  hospital- 
spons  irod  ambulatory 
care,  ED  and  special 
care  patients 
Represontet I ve  sample 


CONTENTS 


.  Review  shat  I  Include 
indications  tor  surgery 
.  May  use  scrooning 
mechanisms  with  pre¬ 
determined  crltoria 


In  cooperation  with 
pharmacist  and  other 
disciplines  as  roquirud 


.  Roviow  for  timoly  ccnp lo- 
fi  on,  clinical  porti- 
nunco,  ovoral I  adequacy 
for  uso  In  quality  assess¬ 
ment  activities,  and  as 
mod i co- I ega I  documents 
.  Required  nursing  and 
medical  record  staff 
part  ic  i  pat  ion 


May  bo  performed  through 
retrospective  patient  care 
evaluation,  medical  record 
review,  or  othor  patlont- 
spoclflc  review  mechanism 
Rev  low  for  propor  utili¬ 
zation  of  blood  trans¬ 
fusions 

Shal  I  review  whole  vs. 
component  blood  olemonts 
Shall  review  all  actual 
or  suspected  reactions 
Should  rev  lev  amount 
requested,  used,  and 
wastage 


A 

J 


hV  *  A  *  A  . 


i 


STANDARD 


12.  Pathology 
and  Nodi¬ 
cal  Labor¬ 
atory 
Services 


13.  Phar— cao- 
tleal 
Sarvlcat 


aasai 


Unspecified 


Unspocl  Mod 


14.  Radiology 


Unspocl  Mod 


Rabat 1 1 1- 
tat  loo 
Prograos/ 
Sarvlcas 
Including 
as  appl  I- 


ony  apo¬ 
dal  Izad 
sarvlcas 
provided 
Including 
Physical 


Quarterly 


SCOPE/FOCUS 


Participation  In  hos¬ 
pital  QA  program 
Sorvtcovlde  quality 
control  program  to 
assure  ral labt I Ity  of 
laboratory  data 


Include  departmental/ 
sorv tce/ind I vl dua I 
prejcrlbor  rev  lev 
Representative  sample 
Introdepartmental 
quality  control  strat¬ 
egies  such  as  drug 
profile,  policies/ 
procedures,  etc. 


.  Review  to  Include 
Inpatient,  outpatient, 
and  EO  services 


Review  to  Includo 
Inpatient,  outpatient 
and  ED  services 
Representative  sample 


CONTENTS 


Director  of  Pathology  and 
medical  laboratory  assure 
departments'  partici¬ 
pation  In  overall  QA 
program 


.  Should  be  part  of  ovoral I 
hospital  QA  program 
specific  to  drug  utili¬ 
zation  and  effectiveness 
.  May  1  nclude  determining 
usage  patterns  by  clinical 
dopartmon t/phys Ic I ans 
,  Assist  in  establishing 
drug  use  criteria 


Review  and  evaluate 
quality  and  appropriate¬ 
ness  of  services 
Modical  rocord  require¬ 
ments  specified  lpp.159- 
160) 


Systematic  review  and 
evaluation  of  quality  and 
appropr iatenoss 
Predetermined  criteria 
Participation  by  medical 
staff  and  rehabl  1 1  taMon 
personnel 

Modical  record  require¬ 
ments  spoclflod  (pp.164  - 


BE 


SCOPE/FOCUS 


CONTENTS 


16'  Rasplratory  Quarterly 
Care 


Review  Includes  in¬ 
patients,  outpatients' 
None  care  patients,  and 
outside  services.  It 
used 

Representative  samplo 


•  Physician-director 
rusponslbl  I  Ity 

,  Should  be  performed  within 
ovoral 1  hospital  QA 
program 

.  Review  and  evaluate 
quality,  appropriateness, 
and  of  feet Iveness 

•  Shalt  use  medical  record 
and  proostabl I  shed 
criteria.  Including  Indi¬ 
cations  for  use, 

of  foct  ivonoss  of  treat¬ 
ment,  and  adverse  offsets 
requiring  discontinuance 
of  treatment 

,  Shall  Include  contribu¬ 
tions  of  medical  staff  and 
respiratory  care  services 

•  Particular  attention  to 
highly  utilized  services 

.  Medical  record  requlre- 
monts  spocltlod  (pp.  175, 
176) 


17.  Social 
Services 


Review  Includes  in¬ 
patients,  outpatients, 
home  care  patients  and 
outside  services.  It 
used 

Representative  sample 


Should  bo  porformod  within 
the  over  a  I  I  hospital  QA 
program 

Review  and  evaluate 
quality,  appropriateness 
and  effectiveness 
Includes  all  categories  of 
pat  ionts 

Shall  use  medical  record 
and  preestabl  I  shod 
cr I  tor  ia 

(Indications  for  social 
work  intervention) 
Particular  attention  to 
dlscltargo  planning  and 
timollnoss  of  omorgoncy 
services 

Medical  record  require¬ 
ments  spoclfiod  (p.t80) 


STANOARO 


FREQUENCY 


SCCPE/FOCUS 


CONTENTS 


to.  Special 

Quarterly 

•  Representative  sample 

•  Physician-director 

Unit* 

for  multi- 

for  al  1  units 

respons Ibl 1 1 ty 

(Mlltl- 

purpose 

.  Should  be  part  of  overal 1 

purpose  or 

units; 

hospital  QA  program 

specif le- 

unspecified 

.  Quality,  safety  and  appro- 

purpose) 

for 

pr lateness  evaluated  on 

specl tic 

regular  basis 

purpose 

,  Written  criteria  for  ad- 

units 

mission  to  and  discharge 
from  special  care  units 

TO:  MM  Thomas  Hoffer  MC/CJSA 
DeWict  Arm/  Hospital 
Ft.  Eelvoir,  VA  2.1060 


FFCiM:  MAJ  James  Benvenuti  MJ/U5A 
DeWitt  Army  Hospital 
Ft..  Belvoir,  VA  22060 

DATE:  1  December  1931 

SUBJECT:  PRELIMINARY  Q/A  CRITERIA  FOR  CHART  REVIEW  OF  CORNEAL  ABRASION: 
MINIMUM  DATA  TO  BE  INCLUDED  IN  RECORD 


1.  (If  patient  is  verbal):  some  description  is  given  of  recent  onset 
of  eye  pain  or  feeling  a  "foreign  body"  or  "something  in  the  eye"; 

+/-  photophobia;  mention  is  made  of£any/no  chang a  in  visual  acuity; 
and  some  mention  is  given  to  related  etiologies  such  as  "followed 
a.concussion  or  scratch  to  face1'  or  "wearing  contact  lenses",  etc) 

2.  Objective  confirmation  of  corneal  abrasion  is  shown  by  stating 
either  one  of  the  following: 

_ a.  Observation  of  corneal  light  reflection  using  oblique  side 

moving  illumination  ("flashlight  test")  shows  abrasion 
(or  abrasion  shadows  cast  upon  iris) ;  or 

_  b.  Sterile  fluorescein  strip  reveals  corneal  abrasion  which  was 

not  evident  on  "flashlight  test";  chart  mentions  that 
greenish  speckled  pattern  is  not  dendritic  branching 
(which  would  suggest  Herpes  keratitis) . 

_3.  Evaluation  using  binocular  magnification  and  lid  eversion  excludes 
foreign  bodies  remaining  and  excludes  penetrating  or  perforating 
injuries  into  eye. 

_4U  The  pertinent  normal  eye  findings  are  included,  such  as:  visual 
acuity,  PRERLA,  EOM  intact,  fundoscopic  exam  WML,  cornea 
"otherwise  clear"  and  visual  fields  WML  to  gross  confrontation. 

5.  Pertinent  negatives  are  mentioned,  such  as: 

_  a.  No  corneal  anesthesia,  pigmentations,  diffuse  cloudiness 

or  radiations  into  sclerae. 

_ b.  No  purulent  discharge  associated  with  eye  payiro^  T'u  > 

_6.  Treatment  plan  is  specified:  including  firm  eye-patches  and  a  3-5 
day  course  of  antibiotic  ophthalmic  solution. 

7.  Follow-up  is  specified;  including  reappointment  within  24-36  hours 
for  reexamination. 

8.  Follow-up  is  arranged  until  either  complete  resolution  of  the  problem 
or  referral  for  complications  such  an  infectious  keratitis. 


TO: 

MAJ  Thomas  Hoffer,  MC/USA 
DeWitt  Army  Hospital 

Ft.  Belvoir,  VA  22060 

FROM: 

MAJ  James  Benvenuti,  MC/U 
DeV/it t  Army  Hospital 

Ft.  Belvoir,  VA  22060 

DATE:' 

7  January  1982 

SUBJECT : 

REVISED  Q/A  AUDIT  OF  ETR 

2, 

3, 


Review  of  Emergency  Room  Log  for  the  past  six  months 
yielded  90  cases  listed  as  corneal  abrasion:  5  of  these 
cases  were  eliminated  because  other  diagnoses  were  listed 
on  the  record,  such  as  "conjunctivitis". 


Of  the  remaining  35  records 
clinic  and  were  audited. 


32  ware  available  in  our 


Using  the 
deficient 
a.  12.5% 
40.6% 
21.8% 
46 . 8% 
0.0% 
9 . 3% 
65.6% 
50.0% 
,34.3% 


the  following 


b. 

c. 

d. 

e. 

f. 

S- 

h. 

i. 


Hoffer  Corneal  Abrasion  Criteria 
ies  were  noted: 

=  No  mechanism  of  injury  noted; 

No  subjective  symptom  listed; 

'No  visual  acuity  noted; 

No  fluorescein  test  cited; 

No  eye  inspection  noted; 

Diagnosis  not  given  as  "Corneal  Abrasion"; 
Treatment  Plan  did  not  list  topical  antibiotic; 
Treatment  Plan  did  not  list  pressure  patch; 
Follow-up  did  not  specify  return  within  24  h4-48 


These ' deficiencies  do  not  necessarily  rep 
of  care:  for  instance,  although  the  fluo 
not  cited,  it  probably  was  routinely  done 
Room  staff.  It  is  also  noteworthy  that  t 
only  recently  developed  and  d i.ssominated  : 
recent  few  months,  the  staff  had  no  guide 
Nevertheless,  providing  a  reminder  to  the 
criteria  might  improve  quality  assurance 


resent  poor  quality 
rescein  test  was 
by  the  Emergency 
he  criteria  were 
except  for  the 
lines  provided. 

stas-f  of  these 
at  this  hospital. 


'  0 


/ 
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TO:  COL  Jose  Ossorio,  MC/USA 

DeWitt  Array  Hospital 
Ft.  Balvoir,  VA  22060 

FROM:  MAJ  James  Benvenuti,  MC/USA 
DeWitt  Army  Hospital 
Ft.  Balvoir,  VA  22060 

DATE:  13  January  1982 

SUBJECT:  Q/A  ONGOING  AUDIT  OF  ETR  “CORNEAL  ABRASIONS* 


1.  On  7  January  1982,  an  audit  of  Emergency  Room  records 
for  the  past  six  months  yielded  32  available  records  of 
"Corneal  Abrasion";  the  following  deficiencies  were  noted : 

a.  12.5%  =  No  mechanism  of  injury  noted; 

b.  40.6%  =  No  subjective  symptom  listed; 

C.  21.8%  =  No  visual  acuity  noted; 

d.  46.8%  =  No  fluorescein  test  cited; 

e.  9.3%  *  Diagnosis  not  given  as  "Corneal  Abrasion"; 

f.  65.6%  -  Treatment  Plan  did  not  list  topical  antibiotics; 

g.  50.0%  -  Treatment  Plan  did  not  list  pressure  patch; 

h.  34.3%  =  Follow-up  did  not  specify  return  within  24-48  hrs 

i.  0%  =  No  eye  inspection  noted. 

2.  By  1  December-1981,  the  above  Hoffer  Criteria  had  been 
developed  and  disseminated  to  the  staff.  During  the 
following  month  of  December,  19  charts  of  patients  treated 
for  "Corneal  Abrasion"  were  collected  and  audited.  The 
following  deficiencies  were  noted: 

a.  10.5%  =»  No  mechanism  of  injury  noted; 

b.  36.8%  =  No  subjective  symptom  listed; 

c.  36.8%  =*  No  visual  acuity  noted; 

d.  36.8%  =  No  fluorescein  test  cited; 

e.  0%  =  Diagnosis  not  given  as  "Corneal  abrasion"; 

f.  1Q.5%  =  Treatment  Plan  did  not  list  topical  antibiotics; 

g.  21.0%  =  Treatment  Plan  did  not  list  pressure  patch; 

h.  36.8%  =>  Follow-up  did  not  specify  return  within  24-48  hrs 

i.  0%  =  No  eye  inspection  noted. 

3.  Using  the  Chi-Square  Test  for  analysis,  statist±cally 
significant  improvement  is  documented  for  the  following 
criteria : 

f.  Treatment  Plan  to  list  topical  antibiotic;  and 

g.  Treatment  Plan  to  list  pressure  patch. 

4.  Because  of  the  remaining  high  rate  of  deficiencies, 

a  re-publication  &  dissemination  of  the  Hoffer  Criteria 
for  Corneal  Abrasion  is  recommended  -  to  include  all 
involved  staff. 
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ARE 


OMMENTS 


♦Please  refer  to  back  for  Privacy  Act  Statement 


TO: 


Patient  Representative  Office 
DeWitt  Army  Community  Hospital 
Fort  Belvoir,  Virginia  22060 


Let's  Hear  About. 


Compliments:  Staff  member  (military,  civilian  and  volunteers)  who  are  doing  an 
outstanding  job. 


Suggestions:  An  idea  that  would  improve  our  care. 
Problems:  Something  to  bring  to  our  attention. 


DATE: 


(PLEASE  PRINT) 
NAME: _ 


ADDRESS:. 


MKHI'AI'  ICSDI  Km 
I  .lun  HI  'Ili'U 


Sponsor’s  Social  Security  Number: 


zip  code 
113 


Telephone:. 
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1 i.  The  Patient 


PF.O  Ac;  iv  it 


P.U.O. 


.[.iron  1  v  ■  j  i. 


j  i.  The  Patient  Representative  Office  activities  for  Me: 
A  mate  A-;  which  Lists  the  orobl  an  areas  b-  cl  in  Lc/ierv  ice 

I 

|2.  Analysis  of  vir.couat&rs : 
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ch  L 92 2  are  presented  for  ravie  ■•. 
ic  attached.  (Inol.  1) 


JANUARY 

FEBRUARY 

MARCH 

In format ion/Direct ions 

391 

432” 

498 

452 

Followup  with  Patients 
Contact  with  Staff  or 

70 

78 

125 

'  11% 

Other  Agencies 

231 

226 

231 

21% 

Assistances 

8 

9 

2 

1% 

Compliments 

56 

74 

131 

12% 

Problems 

109 

73 

117 

10% 

TOTAL 

86  5 

892 

1104 

1002 

J 

|3.  The  P.R.Q.  recev'^d  ns  hundred  and  thirty -one  (131)  cunpLuatnts  mis  month:  Ward  4a  (1 
jj  Ward  33  (17),  Ward  43  (12),  Family  Practice  (10),  ETR  (6),  AMIC  (5),  Urology  (5),  Surgery 
j  Orientation  (3),  Opthalraology  (5), Surgery  (4),  Orthopedics  (3),  L  4  D  (3),  03 /GW  (3)  and 
1  Reap i rato ry  Therapy  (3).  The  following  areas  received  2  compliments  each:  OR,  Recovery,  Fo 
j Service,  ICU,  Internal  Medicine  and  Neurology.  Red  Cross,  Ward  3B,  A  4  D,  Anasthesiology , 
1?R0,  Med.  Company,  House  keep  Lag,  PT,  Refill  Pharmacy,  CMO  Clinic,  Occupational  Health,  CCU, 
^and  Cardiology  received  one  compl latent  each. 

4.  Comments  about  the  matrix  Clncl.  1) 

CENTRAL  The  complaints  about  this  service  have  significantly  decreased  again  this 

APPOINTMENTS;  month.  It  is  interesting  to  note  the  number  of  complaints  regarding  the 
phones  in  Family  Practice  and  in  Pediatrics. 

ETR/TRIAGE:  .  Poor  communications  resulted  in  at  least  12  of  these  complaints  this  merit 

1 

|  INPATIENT:  Three  patients  stated  that  the  staff  on  Ward  43  are  doing  a  good  job,  but 

'  they  seem  terribly  overworked!! 

No  other  trends  were  noted  this  month. 

5.  Case  of  the  month: 

PROBLEM  H:  An  11  y.o.  dependent  son  and  his  father  arrived  at  the  Orthopedic  Clinic  at 
approximately  0930  hours  on  a  Thursday.  They  supposedly  were  referred  by  Ouantico,  but  t.’.av 
had  no  appointment  and  no  referral.  PROBLEM  2:  Orthopedics  referred  the  patient  to  AMIC 
for  a  referral  not  thinking  that  AMIC  doesn’t  see  anyone  less  than  L3  -.a.  PROBLEM  ■:>  3 :  AMI': 

.■  recurred  the  patient  to  Pediatrics  where  lie  was  g iven  a  'routine"  referral  to  Orthopedics. 

I  He  returned  to  Orthopedics  where  he  was  told  that  he  would  need  to  make  an  appointment 
through  CAS.  The  CAS  intercom  phones  were  out  of  order.  PROBLEM  v;4 :  The  CAS  supervisor 
was  making  appointments  in  person,  but  the  soonest  appointment  was  for  one  month  in  advance, 
ilhe  patient’s  father  felt  that  this  was  unsatisfactory  so  he  returned  to  Pediatrics  to  have 
^Kyvetn  change  the  referral  from  "routine"  to  "TODAY".  He  then  returned  to  Orthopedics. 

PRU3LEN  £5:  By  this  time,  the  emergency  doctor  in  Orthopedics  had  been  called  to  the  Erne r gam 
|  Room.  The  patient  and  his  dad  were  asked  to  wait,  but  they  did  not  wish  to  do  so.  They 
i 
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'■-a  ••'--■tic  ^-100  jjc; 


KSXA-CS 

PRO  Activities  -  March 

w*3  cculd  not  determine  if  the  patient  was  referred  fret  Cunnc iuo  or  not.  With  the 
exception  of  Problem  i!2,  the  staff  gave  this  patient  the  correct  information  about 
"the  system"  tor  being  soon.  Tour  hour a  later,  however,  the  patient  end  his  father 
left....  The  dad  said  that  he  would  followup  with  a  torr.nl  r'  r.p  La  .cat ,  but  at  this 
time,  he  has  not. 

6.  Additional  to.  .  hs  managed  by  the  P.R-O.  during  this  ...enth  are: 

a.  provided  new  MEDDAC  employees  with  a  brief  orientation  to  the  Patient 
Representative  Office, 


b.  attended  Potomac  Chapter  Society  of  Patient  Representatives  Meeting  at 
Washington  Adventist  Hospital  in  Takoma  Park,  and 

c.  shared  job  description,  monthly  report,  and  records  ideas  with  staff  from 
Fort  Rucker,  Fort  Lea,  and  Fort  Leavenworth  respectively. 

7.  If  you  have  any  comments  or  questions  regarding  the  information  that  is  presented 
in  this  monthly  report,  please  contact  me  at  ext.  42390. 


I  In  cl. 


'j&77i>JuZ6r;c&xj 

PAMELA  N.  DUNCAN 
Patient  Representative 
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7.0 

CPS 

C,  Dept,  of  Family  Practice 
C,  Dept,  of  Medicine 
C,  Dept,  of  Nursing  (2) 

C,  Dept,  of  Surgery 
C,  Ambulatory  Nursing  Svc. 
C,  CMHA 
C,  CSD  (3) 

C,  Logistics 
C,  EMS 
C,  PAD 

C,  Pathology 
C,  Pharmacy 

C,  Preventive  Medicine 
C,  Radiology 
Commander,  15th  CSH 
Commander,  MED.  CO. 

Navy/MC  Liaison 

CIC ,  '1(73  health  Clinic 

Admin.  Resident 

C,  Force  Development 

.C,  Satellite  Clinics 
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QA  PROBLEM  ASSESSMENT  WORKSHEET 


QUALITY  ASSURANCE  PKL/JRAM 
PROBLEM  ASSESSMENT  WORKSHEET 


if 


Dec 


SE  riO.Y  f  - 1.  DENT  I  FI  CAT  ICN 


A.  Statement  of  Problems: 


B,  Source  of  Data: 

C,  Coirni ttce/Of f ice/ Individual  Identifying  Problem: 

D,  Recommended  Individual/Ccmmittce/Activity  to  investigate  Problem: 


SECTION  1 1  -ASSESSMENT  Date. 

A,  Identify  Applicable  Criteria: 


B.  Feasible  Resolutions: 

4w. 

C.  Recommended  Resolutions: 


D,  Resources  Required: 


SECTION  II I -Executive  Review  Date 


A.  Action  Taken: 

B.  Priority: _ Immediate-Resolve  within  30  days-review  monthly. 

_ Delayed-Resolve  within  6  months -review  monthly. 

_ Long  Range -Resolve  within  3  years -riv'i. :*w  •••nunlly . 

_ Deferred-Resolution  not  feasible  witn  current 

resources -review  annually. 


*  MHDP.AC  (C3B)  FORM  322 
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SECTION'  IV-  IN'-PaGGniiS*  KaVEEVS 


A.  Status: 


B.  Status: 


C.  Status: 


D.  Status: 


E.  Status: 


SECTION  V- RESOLUTION 


Statement  of  Resolution: 


SECT  ION  VI - FOLLOW - UP/ RE V I EW 


Wv. 
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SOUTH  POST  HEALTH  CLINIC 

10  Most  Frequent  Medical  Complaints  and  Diagnoses 
CHIEF  COMPLAINT  (Reason  for  Patient  Presenting) 


DESCRIPTION 


ACTUAL  H 


diagnoses  treated  in  the  clinic 

FIGURE  I.  1 

J  124 

gsaaiiia^^ 


1 

Musculoskeletal  Pain 

63 

3.9.8  « 

2 

Rash 

33 

10.4  5 

3 

Follow-up 

24 

7.5  > 

4 

Sore  Feet 

21 

6.6  > 

5 

Back  Pain 

18 

5.7  S 

6 

Physical  Exam 

i4 

4.4  4 

7 

Blood  Pressure  Check 

13 

4.1  B 

7 

Sore  Throat 

13 

4.1 

o 

Stomach  Pain 

10 

3.1  ! 

10 

Conjestion 

_£ 

2.8 

TOTAL  FOR  THE  TOP  10 

218 

68.8  5 

#Total  Useable  Observations 

318 

Diagnoses  (Dispositions) 

f 

1 

Referrals 

25 

8.7  *> 

2 

Physical  Exam 

15 

5.2  3 

3 

Bronchitis 

13 

4.5  !5 

4 

Muscle  Strain 

11 

3.8  i 

4 

Blood  Pressure  Check 

11 

3.8 

it 

Muscle  Spasm 

11 

3.8 

7 

Sinusitis 

9 

3.1  Q 

7 

Tendonitis 

9 

3.3.  y 

7 

Upper  Respiratory  Infection 

9 

3,1  i 

7 

Rash 

3.1  h 

TOTAL  FOR  THE  TOP  10 

122 

42.7  5 

' 

## 

Poison  Ivy 

8 

2.8  ? 

*# 

Prescription  Refill 

8 

2,8  \ 

Shin  Splints 

8 

2.8  tj 

## 

Sprained  Ankle 

8 

2.8  j 

## 

Gastritis 

8 

2.8  * 

*# 

Common  Cold 

8 

2.8  ft 

TOTAL  FOR  THE  TOP  16 

170 

59.4  jjj 

*T'otal  Useable  Observations 

v 

> 

■> 

*The 

clinic  surveyed  a  total  of  454  patients,  the 

total 

number  of 

observations  listed  J 

under 

complaints  and  diagnoses  refers  to  the  number  of  useable/identi fiab 1 c  entries  for 

those 

categories . 

**These  diagnoses  were  added  in  order  to  portray  a 

more 

complete  p 

icture  of  the  range  of  f 

10  Most  Frequent  Medical.  Complaints  and  Diagnoses 
CHIEF  COMPLAINT  (Reason  for  Patient  Presenting) 


RANK 

DESCRIPTION 

ACTUAL  H 

% 

1 

Musculoskeletal  Pain 

46 

14.7 

2 

Sore  Throat 

31 

9.9 

2 

Cough 

31 

9.9 

1+ 

Follow-up 

22 

7.0 

5 

Rash 

19 

6.0 

6 

Flu  Symptoms 

18 

5.8 

T 

Congestion 

15 

4.8 

7 

LBD 

15 

4.8 

9 

Earache 

13 

4.2 

10 

Eye  Pain 

10 

3.2 

TOTAL  FOR  THE  TOP  10 

220 

70.3 

HTotal  Useable  Observations 


Diagnoses  (Dispositions) 


Referred 
Allergy  Rhinitis 
Sinisitis 
Bronchitis 
Flu  Syndrome 
LBD 

Tendenitis 

URI 

Pharengitls 
Viral  Syndrome 

TOTAL  FOR  THE  TOP  10 

#Total  Useable  Observations 


*The  clinic  surveyed  at  total  of  343  patients,  the  total  number  of  observations 
listed  under  complaints  and  diagnoses  refers  to  the  number  of  useable/identifiable 
entries  for  those  categories. 


FIGURE  T.  P 
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FAMILY  PRACTICE  CLINIC 


10  Most  Frequent  Medical  Complaints  and  Diagnoses 


CHIEF  COMPLAINT  (Reason 

for  Patient  Presenting) 

RANK 

DESCRIPTION 

ACTUAL  # 

% 

1 

Follow-up  Appointment 

24 

15.6 

2 

Physical  Exam 

12 

7.8 

3 

Pap  Smears 

11 

7.1 

3 

Flu- Symptoms 

11 

7.1 

5 

Ear  Ache 

10 

6.5 

6 

Back  Pain 

8 

5.2 

7 

High  Blood  Pressure 

7 

4.5 

8 

Routine  OB  Visit 

6 

3.9 

9 

Ear  Infection  Follow-Up 

5 

3.3 

10 

Well  Baby  Check-Up 

5 

3.3 

Total  for  the  top  10 

101 

66.0 

*Total  Useable  Observations 

153 

Diagnoses  (Dispositions) 

/Ha, 

« 

Pregnancy 

12 

7.7 

Physical  Exam 

12 

7.7 

3 

Hypertension 

10 

6.5 

4 

LBD 

7 

4.5 

4 

Serous  Otitis 

7 

4.5 

4 

Otitis  Media 

7 

4.5 

7 

Sinus  Infection 

5 

3.2 

8 

Diabetic 

4 

2.6 

8 

Well  Baby  Check 

4 

2.6 

8 

Vaginitis 

4 

2.6 

8 

Anemia 

4 

2.6 

8 

Routine  OB  Visit 

4 

2.6 

Total  for  the  top  12 

80 

51  .5 

*Total  Useable  Observations 

155 

*The  clinic  surveyed  a  total  of  183  patients,  the  total  number  of  observations  listed 
under  complaints  and  diagnoses  refers  to  the  number  of  useable/identifiable  entries 
for  those  categories. 


© 

FIGURE  I.  3 
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OBSTETRICS  AND  GYNECOLOGY 


10  Most  Frequent  Medical  Complaints  and  Diagnoses 

In  this  particular  clinic  the  complaints  and  diagnoses 
are  listed  together  due  to  the  limited  catagories  of 
complaints  and  diagnoses  unidentifiable  by  the  clinic 
staff. 


RANK 

DESCRIPTION 

ACTUAL  # 

% 

1 

CB  Routine 

155 

33.6 

2 

Follow-Up  Appt 

61 

13.2 

3 

PAP  Smear 

39 

8.5 

4 

Vag  Infection 

32 

6.9 

5 

Problem  GYN  -  ? 

27 

5.9 

6 

Preg  Test 

22 

4.8 

7 

Lower  Abdominal  Pain 

20 

4.3 

8 

BCP  Refill 

18 

3.9 

8 

Vaginal  Bleeding 

18 

3.9 

10 

IUD 

8 

1.7 

10 

Colpo 

8 

1.7 

Total  for  the  top  11 

408 

88.5 

♦Total  Useable  Observations  461 


♦The  clinic  surveyed  a  total  of  504  patients,  the  total  number  of  observations  listed 
under  complaints  and  diagnoses  refers  to  the  number  of  useable/identifiable  entries 
for  those  categories. 


FIGURE  I.  4 


SAMPLE  SIZE  CONSIDERATION 
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SAMPLE  SIZE  CONSIDERATION 


This  is  a  brief  discussion  of  sample  size  considerations: 

The  population  size  is  the  number  of  items  which  are  the  subject  of  the  study. 
If  the  population  to  be  studied  are  those  patients  who  are  treated  in  the  emergency 
treatment  room  in  1981,  that  number  may  well  be  50,000.  Conversely,  an  audit  of 
gunshot  patients  seen  in  the  same  clinic  may  represent  only  twenty  incidents.  If  the 
population  is  small  a  complete  audit  of  all  encounters  may  be  possible  and  that 
audit  will  be  very  accurate.  It  is  more  likely  that  the  audit  will  be  on  a  large 
population,  and  therefore  sampling  techniques  are  necessary. 

If  a  sample  needs  to  be  taken  of  the  population  there  are  certain  principles 
that  must  be  observed.  Randomness  of  the  sample  is  the  key  to  arriving  at  a  true 
picture  of  the  population.  Two  conditions  must  be  met  to  achieve  randomness:  (i) 
all  observations  must  come  from  the  same  population,  and  (2)  the  sample 
observations  must  be  statistically  independent. 

The  first  condition  is  met  by  adhering  to  the  criteria  discussed  earlier 
regarding  clear  identification  of  the  subject  of  study.  The  independence  of  the 
observation  is  based  upon  the  point  that  the  observations  should  stand  alone  and 
their  selections  should  not  change  the  value  of  other  possible  observations. 

The  problem  of  randomness  needs  to  be  discussed  further.  If  the  sample  is  to 
be  a  valid  reflection  of  the  population  an  idea  of  what  the  population  looks  like  is 
necessary.  The  sample  should  be  comprised  of  all  elements  of  the  population  or  at 
least  all  elements  of  the  population  must  have  an  equally  likely  possibility  of  being 
selected.  Elements  of  the  population  may  be  excluded  from  the  sample  for 
seemingly  obvious  reasons  in  retrospect.  If  "stat  lab  test"  is  to  be  sampled,  the 
sample  should  provide  the  opportunity  for  all  requestors  of  "stat  lab  test"  to  be 
included.  Limiting  the  time  frame  for  data  collection  so  that  certain  activities  will 
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be  excluded  will  taint  the  results.  If  the  data  collection  is  conducted  on  Tuesday 
and  several  clinics  do  not  operate  on  Tuesdays,  then  those  clinics  will  not  have  the 
opportunity  to  be  represented.  In  determining  the  data  collection  scheme  the 
individual  conducting  the  study  should  be  cognizant  of  the  potential  of  excluding 
population  data. 

Following  the  evaluation  of  how  the  sample  is  to  be  done  to  insure  randomness 
and  independence,  the  size  of  the  sample  needs  to  be  determined.  Sample  size  is 
dependent  upon  the  cost  of  the  sampling,  the  timeliness  of  the  sample,  and  the 
accuracy  desired.  Cost  is  significant  in  any  sample;  the  time  and  effort  required  to 
collect  the  sample  information  should  be  reviewed  before  undertaking  a  quality 
assurance  study.  A  very  short  sample  collection  period  will  reduce  the  size  of  the 
sample.  The  desired  accuracy  of  the  final  result  must  be  taken  into  consideration. 

The  results  of  sample  generally  become  more  accurate  as  the  size  of  the 
sample  increases.  Of  course,  as  the  size  of  the  sample  increases  the  cost  of  the 
study  study  increases  and  the  timeliness  of  the  study  decreases.  The  decision  on 
which  of  these  three  factors  is  the  most  important  is  solely  that  of  the  individual 
who  will  have  to  make  decisions  based  on  the  results.  There  is  no  magic  number 
which  an  individual  can  point  to  and  say  that  is  the  minimum  acceptable  sample 
size.  The  central  limit  theorem  stipulates  that  with  a  large  n  (sample  size  of  30  or 
greater)  the  theoretical  sampling  distribution  of  a  (mean  or  average)  can  be 
approximated  by  the  normal  curve. ^  This  theorem  is  the  basis  for  many 
statistical  tests  and  therefore  the  number  30  is  a  valid  milestone  if  the  individual 
conducting  the  study  plans  to  use  statistical  tests  based  on  the  central  limit 
theorem. 

The  vast  array  of  other  statistical  tests  which  can  be  used  in  evaluating  study 
results  are  not  based  on  the  "large  n"  of  the  central  limit  theorem.  To  use  30  as  a 
guide  may  result  in  incomplete  data  for  other  tests  of  significance.  To  circument 
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the  possibility  of  either  having  too  much  or  too  little  data  the  literature  should  be 
consulted  prior  to  data  collection  to  ascertain  what  sample  size  would  provide 
adequate  information  for  the  statistical  test  to  be  used. 
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DESCRIPTIVE  STATISTICS 


The  occasion  may  arise  that  a  study  concerned  with  "discovery"  is  to  be 
instituted.  Discovery  is  useful  in  describing  a  situation  for  which  a  performance 
objective  is  not  established.  For  example,  the  Chief,  Professional  Services  may  be 
interested  in  the  number  of  times  a  patient  receives  a  busy  signal  when  attempting 
to  call  for  a  medical  appointment.  The  obvious  method  to  obtain  an  approximation 
of  this  problem  is  to  conduct  a  data  gathering  experiment  which  will  consist  of  n 
elements  which  will  together  comprise  the  sample.  The  elements  discussed  earlier 
regarding  factors  which  should  be  considered  in  sampling  apply  i.e.,  timeliness, 
cost,  precision,  randomness,  and  independence.  The  outcome  of  the  sample  should 
provide  a  minimum  of  the  following  elements: 

x  =  Value  of  the  measurement  in  the  sample  (unsuccessful  number  of  phone 
attempts 

n  =  The  sample  size 

x  =  The  sample  mean  (arithmetic  average) 

S2  The  sample  variance 

s  =  The  standard  deviation  of  sample 

mode  =  The  most  common  value  in  the  sample 

R  =  Range  of  values 

median  =  The  middle  value  or  the  average  of  the  two  middle  values  if  an  even 
number  of  values  in  the  range 

In  addition  to  the  above  data  the  sample  results  should  contain  a  graphic 
representation  of  a  frequency  polygon  (next  page).  This  graphic  presentation 
enables  the  observer  to  judge  the  symmetry  and/or  skewness  of  the  sample.  This 
visual  presentation  alleviates  a  great  deal  of  narrative  description  as  the  picture 
speaks  for  itself. 
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The  actual  calculation  of  the  statistics  of  a  sample  and  the  construction  of  the 
visual  presentation  of  the  data  was  performed  by  a  Hewlett-Packard  minicomputer. 

Subsequent  to  data  collection,  computation  of  the  statistics,  and  visual 
presentation,  evaluation  of  the  sample  results  can  be  undertaken.  The  sample 
results  may  reveal  what  is  perceived  as  a  problem  or  the  resu  may  be  favorably 
received  and  the  process  is  ended.  If  the  results  indicate  a  problem  then  the  data 
becomes  the  baseline  data  for  evaluating  the  effectiveness  of  follow-up  actions. 

The  follow-up  hypothesis  can  either  be  based  on  the  initial  results  or  another 
objective.  For  example  if  an  average  (X)  of  3  unsuccessful  attempts  to  reach  the 
appointment  clerk  preceeded  the  actual  telephone  discussion  that  statistic  ($0  or  a 
lower  one,  2  attempts  could  be  the  hypothesized  value. 

H t?3  unsuccessful  attempts  H0:/JjSZ2  unsuccessful  attempts 

or 

unsuccessful  attempts  [HA^2  unsuccessful  attempts 

The  sample  is  extremely  useful  in  developing  a  basis  for  decision  making  and 

subsequent  evaluation  of  follow-up  action  effectiveness. 


HYPOTHESIS  TESTING 
(LARGE  SAMPLE) 
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HYPOTHESIS  TESTING 


(LARGE  SAMPLE) 

Hypothesis  testing  is  applicable  to  studies  which  have  a  predetermined 
compliance  level  which  will  be  used  to  judge  performance  based  on  clinically  sound 
criteria.  For  example,  the  pathologists  are  concerned  whether  "stat"  tests  are 
actually  being  evaluated  by  the  staff  appropriately.  The  sole  criteria  for 
evaluating  the  situation  might  be  "annotation  in  medical  records  of  test  results 
within  24  hours  of  completion  of  test."  In  order  to  test  this  criteria,  a  number  of 
decisions  need  to  be  made: 

1.  Determine  an  acceptable  compliance  rate.  In  many  areas  a  goal  of  100%  is 
mandated.  In  this  example  90%  will  be  used. 

2.  Establish  a  level  of  confidence.  This  is  the  probability  of  being  correct.  In 
this  example  the  pathologist  desired  a  95%  probability  of  being  correct. 

3.  Develop  the  hypothesis  and  define  the  terms.  The  expression  of  the  hypothesis 
in  statistical  notation  is  not  necessary  but  is  helpful  for  convenience.  To  be  able  to 
use  notation,  a  legend  of  symbols  to  be  used  is  included. 

P  -  The  population  portion 

n  =  The  sample  size 

x  =  The  number  of  samples  which  fulfill  the  criteria 

p  =  The  sample  proportion,  the  estimate  of  P 

°"p  =  The  standard  error  of  the  sampling  distribution  of  the  sample 
proportion 

H0  =  The  null  hypothesis 
Ha  =  The  alternate  hypothesis 
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PQ  =  A  number  representing  a  hypothesized  value  of  the  population 
C^=  Level  of  significance,  i  -  (level  of  confidence) 

E  =  Maximum  tolerable  difference  or  error  between  the  population 
portion  and  the  sample  estimate 
Zw  =  The  standardized  normal  variate  use  in  a  one-tail 
CV  =  The  critical  value 

The  standardized  normal  variate  use  in  a  two-tail  test. 

Not  all  the  values  for  the  symbol  shown  above  have  been  computed  as  of  yet.  At 
this  point  the  hypothesis  can  be  developed. 

H0 :  P  .90=  (the  population  proportion  complying  with  the  criteria  is  equal  to 
or  greater  than  90%) 

H^:P  .90=  (The  alternative  hypothesis  is  that  the  compliance  rate  is  less  than 
90%) 

dL  a  ,05=  (95%  probability  of  being  correct) 

Z*  =1  ,65=  Standard  normal  value  ofo^r  .05  in  a  one  tail  test  of  significance 
(Z  value) 

4.  Determine  the  sample  size.  Several  decisions  need  to  be  made  in  estimating 
the  sample  size. 

a.  Determine  the  maximum  percentage  of  error  in  estimating  the  portion  of 
the  population  which  is  fulfilling  the  criteria.  The  pathologist  wants  the  estimate 
of  the  population  portion  not  to  differ  from  the  actual  population  portion  by  more 
than  .05  (5%). 

b.  Compute  the  sample  size.  One  last  decision  has  to  be  made  prior  to 
computing  an  estimate  of  what  the  portion  of  compliance  is.  Despite  the 
incongruency  since  the  purpose  of  the  audit  is  to  determine  the  portion,  some  value 
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must  be  assigned.  An  estimate  of  50%  will  result  in  the  largest  sample  size 
estimate,  deviation  either  side  of  50%  will  decrease  the  sample  size  estimate.  A 
small  pilot  audit  might  suggest  a  figure  of  70%  or  the  pathologist  may  just  have  an 
intuitive  estimate.  If  in  retrospect  the  sample  size  was  too  small  the  preciseness 
of  the  estimate  will  suffer.  Similarly,  if  the  sample  size  is  actually  greater  than 
necessary  the  precision  of  the  estimate  will  increase.  In  this  example  a  pilot  study 
suggests  that  a  compliance  rate  is  approximately  80%.  The  following  information 
is  now  available. 

E  =  .05  Maximum  difference  or  error  between  the  population  portion  of 
compliance  and  the  sample  estimate. 

P  =  .80  Estimate  of  actual  compliance  based  on  pathologist's  estimate 


oC  =  .05  Level  of  significance 
2^=  1.65  Z  value 

To  compute  the  sample  size  estimate  the  following  formula  is  used: 
n=P~(  1-P)  /  =-80(.20)(1.65/.05)2 

.80(.20)(33)2  =  .80(217.8)  =  174.2  or 
175,  always  round  up 


5.  Conduct  the  audit  and  record  results.  The  number  of  charts  which  fulfill  the 
audit  criteria  x  is  divided  by  the  number  of  records  audited,  n  or  sample  size,  to 
arrive  at  p,  the  sample  proportion  or  estimate  of  P.  Continuing  this  example  180 
records  were  audited,  n  -  180,  and  150  met  the  criteria,  x  =  150.  The  calculation  of 
the  sample  portion  is: 

p=x/n=150/180=.833 


fi 
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6.  Test  the  hypothesis.  The  test  of  the  hypothesis  involves  the  following 
information: 

n=180A=.05,  X=150,  Po=.90,  Z<*  =  1.65, 

CV=unkown,  p=unkown. 

H0:  P  £.90  Ha:P-s.90 

The  criteria  value  represents  the  decision  point  in  the  hypothesis  test.  The 
critical  value  is  a  combination  of  the  hypothesis  value  of  the  population  with  an 
adjustment  which  is  the  standard  error  of  the  sampling  distribution.  The  result  is  a 
value  below  which  the  null  hypothesis  can  be  rejected.  The  calculating  formula  for 

Op  is: 


The  critical  value  (CV)  =  Pq  -  £<0^= 

. 90-1. 65(. 0223607)= 
.90-. 037= 

.863 


Decision  rule: 

ACCEPT  HQ :p  £ . 863 
REJECT  HA:p-* .  863 

The  value  of  p  =  .83  (i.e.,  p  )  therefore  the  null  hypothesis  is  rejected 

180 

and  the  alternate  hypothesis  is  accepted.  Referring  back  to  the  development  of 
the  criteria  for  the  study  it  can  be  concluded  that  "stat"  test  results  are  not 
annotated  in  the  medical  record  within  24  hours.  Before  concluding  the 
pathologists  may  want  to  check  the  possible  error  in  estimating  the  population 
portion  based  on  the  sample  size  and  portions.  This  relates  back  to  the  sample  size 
estimate  formula, 

n=P(  1-P)  (ZoC/E)2 


140 


That  formula  can  be  manipulated  to  solve  for  E, 

Based  on  the  survey  results  the  value  of  E  is: 

E=1.65  . 83(1- .83)  = 

180 

1.65(. 027998)=. 046 


The  final  value  of  E  (.046)  is  less  than  the  value  stipulated  earlier  in  the  problem 
(.05)  therefore  the  sample  size  estimate  was  adequate. 


ANALYSIS  OF  VARIANCE 


The  analysis  of  variance  test  is  useful  in  evaluating  the  effectiveness  of 
quality  assurance  lollow-up  actions.  The  analysis  of  variance  test  enables  the 
individual  conducting  a  study  to  evaluate  the  effectiveness  by  comparing  the 
compliance  rates  for  the  various  criteria  in  two  random  samples  by  comparing  the 
sample  variances.  An  explanation  of  the  reasons  why  an  evaluation  of  sample 
variance  can  be  used  to  determine  whether  the  compliance  rates  are  equal  ur 
statistically  different  is  again  best  left  to  the  statistics  textbooks. 

An  example  of  the  analysis  of  variance  test  will  be  demonstrated  via  the  audit 
data  included  in  the  corneal  abrasion  audits  (Appendix  D  and  E).  The  criteria  for 
the  audit  was  developed  (Appendix  D),  and  an  initial  audit  of  32  records  revealed 
the  following  non-compliance  rates: 

Criteria: 


a. 

No  mechanism  of  injury  noted 

Initial 

12.5% 

Follow-up 

10.5% 

b. 

No  subjective  systems  listed 

40.6% 

36.8% 

c. 

No  visual  activity  noted 

21.8% 

36.8% 

d. 

No  fluorescein  test  cited 

46.8% 

36.8% 

e. 

No  eye  inspection  noted 

0% 

0% 

f. 

Diagnosis  not  given  as  "corneal 
abrasion" 

9.3% 

10.5% 

g* 

Treatment  plan  did  not  list 
topical  antibiotic 

65.6% 

21.0% 

h. 

Treatment  plan  did  not  list 
pressure  patch 

50.0% 

36.8% 

i. 

Follow-up  did  not  specify 
return  visit  within  24  -  48 
hours 

34.3% 

0% 
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The  results  of  the  study  prompted  actions  to  educate  the  emergency  room 
staff  on  the  criteria  which  would  be  the  yardstick  for  further  evaluation.  The 
effectiveness  of  the  follow-up  actions  was  measured  by  an  audit  of  19  charts  using 
the  same  criteria  and  the  results  are  listed  in  the  follow-up  heading  above.  Taking 
into  account  the  negative  approach  of  the  audit  and  the  measurement  of  non- 
compliance  rather  than  compliance,  the  follow-up  figures  reflect  a  general  overall 
improvement  in  care.  The  question  is  whether  it  is  statistically  significant.  The 
analysis  of  variance  test  provides  the  framework  for  determining  whether  the 
improvement  is  based  on  an  actual  increase  in  the  performance  of  the  emergency 
room  staff  or  if  the  improvement  can  be  attributed  to  chance. 

To  illustrate  the  analysis  of  variance  test,  the  data  for  the  corneal  abrasion 
test  was  fed  into  the  hospital's  minicomputer.  The  calculations  involved  in 
performing  this  test  are  tedious  and  best  left  to  a  computer.  The  printout  (next 
page)  provides  a  number  of  key  values  for  the  individual  who  conducts  the  study  to 
review.  The  top  array  of  data  listed  as  treatment  //I  and  //2  is  merely  the  non- 
compliance  rates  for  the  initial  (treatment)  and  the  follow-up  (treatment  2)  audits. 
Next,  the  computer  calculated  the  mean  (average)  non-compliance  rates  for 
treatment  1  and  2.  The  variance,  i.e.,  471.1536  and  262.6319  respectively  is  the 
sum  of  all  the  (observed  values  -  mean)2  The  initial  study  had  a  non-compliance 
rate  of  31.211196  and  the  follow-up  audits  non-compliance  rate  was  21.22%.  The 
decrease  in  noncompliance  (10%)  is  sizeable  but  the  key  to  determining  if  this 
reduction  was  statistically  significant  is  the  F  statistic.  In  this  example  the  F 
statistic  is  1.2733.  If  the  auditor  wants  to  be  95%  confident  that  the  difference  in 


the  mean  values  of  the  sample  results  is  not  due  to  chance,  a  critical  value  of  the  F 
statistic,  in  this  case  of  1  degree  of  freedom  in  the  numerator  (DF  NUM)  and  16 
degrees  of  freedom  in  the  denominator  (DF  DEN),  the  critical  value,  4.49,  can  be 
extracted  from  any  statistics  textbook.  The  calculated  F  statistic  1.2733  is  less 
than  F  critical,  4.49,  therefore  the  auditor  is  not  able  to  state  that  the  differences 
in  the  non-compliance  rates  are  different  and  be  95%  confident  of  being  correct. 
The  printout  shows  the  level  of  significance  associated  with  an  F  statistic  of 
1.2733.  By  subtracting  the  level  of  significance  from  l,  the  level  of  confidence  is 
revealed  (1  -.2758  =  .7242).  In  any  statement  regarding  the  difference  between  the 
non-compliance  rates  the  auditor  could  only  be  72.4%  certain  the  difference  was  do 
to  actual  changes  in  the  staff's  compliance  with  the  audit  criteria. 

The  analysis  of  variation  test  appears  to  be  extremely  complicated  at  first 
glance  but  with  the  aid  of  the  computer  the  clinican  has  a  powerful  analytic  tool  at 
his  disposal.  The  F  statistic  is  the  key  to  evaluating  the  test  results  and  the 
Hewitt-Packard  minicomputer  automatically  calculates  not  only  the  F  statistic  but 
also  the  level  of  significance  for  the  test.  By  subtracting  the  level  of  significance 
from  1,  the  clinican  has  the  level  of  confidence  which  the  results  represent.  The 
determination  of  what  level  of  significance  is  necessary  to  demonstrate  a  real 
change  depends  on  the  level  of  risk  the  individual  conducting  the  study  is  willing  to 
take  in  accepting  the  results. 
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QA  STUDY  DEVELOPMENT  FORMAT 


The  twelve  steps  listed  below  were  developed  by  the  author  as  a  guide  to 
insure  completeness  of  a  QA  study. 

Steps: 

1.  Determine  the  procedure  to  be  audited.  This  selection  process  can  be  based 
on  cost,  sudden  increase  in  number  of  tests  performed,  possible  delitarious  patient 
effects,  identification  of  problems  involved  with  the  procedure  by  hospital  staff  or 
patients,  or  any  other  problem  identification  process. 

2.  Establishment  of  audit  criteria.  The  criteria  should  be  explicit  and 
thoroughly  understood  by  those  who  will  conduct  the  audit.  The  criteria  should  be 
acceptable  to  the  staff  who  order  the  procedure. 

3.  Determine  the  compliance  level  which  will  be  standard  for  evaluating  the 
audit  results.  The  establishment  of  a  compliance  of  100%  will  almost  assure  an 
unfavorable  outcome,  if  a  compliance  rate  of  90%  or  85%  is  acceptable, 
consideration  should  be  given  to  setting  a  standard  less  than  100%. 

4.  Select  the  statistical  test  which  will  allow  a  valid  conclusion  to  be  drawn  on 
whether  the  audit  results  meet  the  compliance  goal.  A  more  complete  discussion 
on  selection  of  a  statistical  test  is  in  the  next  chapter. 

5.  Determine  the  sample  size  which  is  necessary  to  gather  sufficient  data  to 
conduct  the  statistical  test.  A  reminder  that  if  records  must  be  retrieved  from  the 
outpatient  records  area,  double  the  number  of  records  requests  due  to  the 
previously  mentioned  retrieval  problems. 

6.  Identify  the  records  to  be  audited.  The  laboratory  and  radiology  copies  of 
test  results  provide  the  key  to  identification  of  the  patients  to  be  audited.  For 
pharmacy  the  prescription  form  also  provides  the  same  information.  In  selecting 
the  records  to  be  audited,  the  randomness  of  the  selection  process  must  be  insured. 
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The  outpatient  record  branch  must  have  both  the  patient's  name  and  social  security 
number  to  be  able  to  locate  the  record. 

7.  Conduct  the  audit.  The  actual  performance  must  be  measured  against  the 
criteria  and  recorded  on  a  worksheet.  Confidentiality  of  the  patient  and  the 
provider  must  be  insured.  This  can  be  accomplished  by  using  a  code  to  identify  the 
provider,  assigning  numbers  is  acceptable.  The  last  four  numbers  of  the  patient's 
social  security  number  is  adequate  identification  of  the  patient.  A  key  which  lists 
the  patients'  names  and  social  security  numbers,  as  well  as  the  provider  and  his 
code  number  should  be  safeguarded  by  the  official  conducting  the  audit.  An 
example  of  a  worksheet  is  in  the  following  chapter. 

8.  Perform  the  statistical  test.  The  statistical  test  will  provide  a  statistical 
basis  for  evaluating  the  actual  clinical  practice  of  the  population  of  interest  as 

vvj*  measured  against  the  criteria. 
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9.  Draw  conclusions  based  on  the  statistical  results.  If  the  results  are  obvious, 
either  good  or  bad,  the  conclusions  can  be  drawn  quickly.  The  results  may  not  be 
clear.  A  judgement  of  whether  the  statistical  significance/insignificance  also 
represents  practical  significance/insignificance  will  have  to  be  made  by  the 
individual  reviewing  the  results.  A  statistical  significant  result  may  not  present  a 
problem  in  the  practical  sense.  The  conclusion  should  address  both  the  statistical 
and  practical  significance  of  the  findings. 

10.  Develop  recommendations.  If  the  findings  indicate  problems, 
recommendations  for  resolution  of  those  problems  need  to  be  developed.  If  the 
actions  to  correct  the  problems  are  outside  the  department  then  the  individuals 
who  do  have  the  authority  must  be  notified. 

11.  Establish  follow-up  studies.  The  process  of  quality  assurance  is  not  complete 
until  the  problem  is  corrected.  To  insure  compliance,  follow-up  studies  are 
required.  The  frequency  of  follow-up  is  dependent  on  the  nature  of  the  problem.  If 
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actions  to  correct  the  problem  can  be  taken  quickly  then  the  follow-up  study  may 
be  scheduled  shortly  after  the  initial  study.  Whatever  the  situation,  the  follow-up 
study  has  to  be  done  to  validate  the  efficiency  of  the  remedial  actions.  Some 
problems  may  require  constant  monitoring;  the  emergency  room  has  a  constant 
flow  of  providers  and  therefore  to  assume  that  a  problem  is  resolved  based  on  one 
satisfactory  follow-up  audit  may  not  be  valid  in  the  long  run. 

12.  Submit  the  study  to  the  quality  assurance  committee.  The  complete  audit 
should  be  forwarded  to  the  hospital  quality  assurance  committee  to  insure  that  the 
flow  of  information  is  maintained. 
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